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ABSTRACT 

Results of research performed to determine whether or 
not newly enrolled freshman students improved after one and one- half 
quarters of composition instruction at Western Illinois University 
are presexited. Using an essay-type placement test given at initial 
enrollment as a pre-test, 158 students were selected as the 
experimental group to write post- test essays after one and one-half 
quarters of composition bad been completed. Both the pre-test and 
post-test essays were subjected to an analytic evaluation which 
numerically rated each student on the areas of content, organization, 
style, mechanics, and overall score on the essay. A paired test 

and a Duncan's Multiple Range test were used to analyze the essay 
scores data. The general findings and overall conclusions drawn from 
the study indicated, that freshman students do improve their writing 
ability after one and one- half quarters of composition. That, the 
improvement was due solely to composition instruction cannot be 
confirmed since no control group existed to control maturation an^ 
other possible extraneous variables. A total of 30 null hypotheses 
were tested in this experiment, statistical data are presented in 16 
tables and in three appendixes. (DB) 



ED 



u s mmm of huith. mcm% & wiiu« 

OfftCl Of EDUCMIOH 



1 HIS DOCUMIHI HAS IIEH REPRODUCED EXACUV AS RECEIVED EROM THE 
PERSON OR 0 RGANIZA 1 I 0 N 0 RI 61 NA 1 IN 6 11 . POINU OF VIEW OR OPINIONS 
STATED W Ml NKISSAMV lEMESEW OffICUl OffiCE Of EDUCATION 
POSITION OR POllCY. 



AN ANALYSIS OF THE EFFECTIVENESS OF FRESHMAN COMPOSITION 
AS IT IS TAUGHT AX WESTERN ILLINOIS ONIVEF^ITY 



A Study 
Presented to 

the Departments of Education and English 
Western Illinois University 



In Partial Fulfillment 



of the Requ5.rements for the Degree 



Master of Science In Education 







by 



Kenneth Edward Reach 



n K aoaiaTH E. gea-m 



It 

o 

o 



April, 1972 




THE EMC sifSIW KOUlWJ MMHSSOH Of 
IHC COPYHOHt OWHEI." 



ERIC 



i 






A writer Is an Individual who uses language to discover meaning 



in experience and coosnunicate it. 



Donald M, Murray 
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PKSFACE 




The kemal Idea around which this entire study has been developed 
was planted long ago while I was still an undergraduate student in 
English Education. Numerous instructors — chief of whom were Mr. Stacy and 
Dr. Lin dsey-'-s tressed the need for competence in the field of English. 

I said competence, not scholarship, for there is a world of difference 
betv;een the two. Their deep and abiding concern was with the ability 
to effectively write a meaningful essay; and, even further, to be able 
to teach the translatable skills of composition to others . 

Inspired by this view, I proceeded to teach composition in high 
school and at the college level as well. The need for effective teaching 
was obvious. Unfortunately, there seemed to be some 'juration concerning 
the effectiveness of our teaching on the collegiate level. Thus, this 
study was bom out of a desire to see If we are fulfilling our obliga- 
tions and also if there is empirical evidence to substantiate progress 
being made by students in composition. It is sincerely hoped that the 
findings presented here will aid the composition Instructors at Western 
in finding areas of concern in the teaching of writing to freshman 
students, and thereby helping those students become competent writers 
of effective and meaningful prose. 
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Chapter 1 



INTRODUCTION 



The State of English 

Since 1957 when the Sputnik hailed In the Space Age, education In 
the broadest eense of the word has been In a seemingly constant state of 
flux. Every new class of graduates with teaching certificates feels 
that they have the panacea to cure the ills that have befallen the 
educational system today. Unfortunately, very few of their Idealistic 
remedies succeed; and therefore the state of turmoil within our various 
academic disciplines continues. English is not without its share of 
problems . 

Of all the different subjects which students confront In the educa- 
tional process, English is probably the one subject taught nearly every 
year they attend school. Since this Is the case, then, there should be, 
must be, some rationale behind what we do within the English classroom. 

On the one hand, teachers of English realize that their discipline Is 
of paramount importance In the school curriculum; because without an 
adequate knowledge of English, students would have considerable diffi- 
culty In communicating* At the other end of the spectrum, it must also 
be mderstood that English Is a very enigmatic problem simply because 
there have been so many different methods of approach offered to fulfill 
the objectives of teaching students their language. Basically, there are 
two broad areas that are the concerns of English teachers on nearly all 
levels of education, namely literature and language. The area of lan- 
guage, a very diversified field, concerns a variety of basic skills; 
Important among them are grammar, composition, speaking, reading, listen- 
ing, and understanding. ^ . 
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Applebee and Squire (2-1965) report that award winning high achool 
English teachers in the high schools surveyed use over ^ 52^ of their ' 
classroom time emphasizing literature and the remaining time is divided 
among all the other concerns of English with conposition receiving ahout 
14% of the classroom time.^ Since it appears that composition is not of 
major importance compared with literature, the question often raised 
concerning its effectiveness and necessity is one that truly needs in- 
vestigation. 

The State of Composition 

Wilcox (42-1968) reports, in a preliminary study of English pro- 
grams at selected universities across the nation, that 93% of all 
institutions polled required one term of composition and 78% required 
two terms. ^ He further found that over 40% of the total teaching time 

q 

in the English departments was devoted to freshman composition. It 
would appear from these statistics that institutions of higher educa- 
tion deem the teaching of composition a necessity. To further point up 
the concerns of composition, one needs only to glance at a current book 
publisher's catalDgue to see the various composition and rhetoric hand- 
books, essay readers, workbooks, and books teaching the skills of writing 
that are continually offered to the teacher of English, Since colleges 
are concerned with the teaching of composition, it follows that there 
should be some definable curricular objectives for what goes on in the 
classrooms. Quite often on the college level, freshman composition 
courses are organized around syllabi which objectively attempt to struc- 
ture the program around areas of concern that each English department 
feels are important for the students to utilize and understand. Yet, 
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even though universities mey adopt relatively rigid syllabi, a problem 







is more rigid, university level teaching is tradltlohally looked at as 



being consider^ly noj^e ^relaxed lhis^ 4* .^9t 

universities should adopt the rigid programs used on the lower levels of 
education. However, it is to say that it is necessary to justify this 
commitment of time end effort by objective means. 

In order to ward off criticism for what goes on in English composi- 
tion courses, teachers must face the perplexing problem: of proving that 
they teach their students skills that are translatable to other academic 
areas. For decades serious research has been done in order to ascertain 
the role of Freshman Composition on the university level. Kitzhaber has 
capsulized the problem plaguing teachers of composition when he says: 

The deficiencies of high school English courses and textbooks 
and of the professional preparation of many high school teachers 
of English have now been made a matter of public concern, and 
rightly so if any large-scale Improvement is to be brought 
about. But what about the college English courses that nearly 
half of all high school graduates will take as freshmen? How 
good are these courses? How well are they being taught? What 
is in them? What are their announced purposes? What forms do 
they take? Do they avoid weaknesses and errors for which col- 
lege English teachers have blamed English course:; in the 
secondary schools ?4 

The problem is serious. If teachers are honestly to attempt to resolve 
the questions posed by Kitzhaber, then they must carefully scrutinize 
what occurs in their composition programs as they are presently estabr.i 
lished. Many studies have been done concerning freshman programs and 
most of them, chiefly those done by Miller (36-1958) and Fellers (18- 
1953) report a dismal picture of composition teaching* 
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ITje Freshman Co- r^posltton Program At Western Illinois University 

Th® freshmr i 'composition staff at TTestem Illinois University makes 
every effort to properly place incoming students into a course designed 
With their compeieiieles or week^eeeee In »ln£. By taking Into cotisldet- 
ation a summer placement essay and various test scores taken by students 
(these include ACT scores, high school English grades, etc.) prior to 
enrollment, each freshman is placed in either the 111 or 101 sequence of 
composition, or if the student is superior, he receives Advanced Place- 
ment. The 111 sequence of composition is designed for the student with 
more serious problems in organization and syntax, while the 101 sequence, 
by incorporating more literature, allows more advanced students an 
opportunity to respond to ideas fcund in literature. Each sequence is 
Independent of the other and has a separate syllabus outlining the 
course objectives that should be incorporated over the three quarters. 
Realizing that no means of measuring student placement is absolute, the 
freshman composition program at large leaves room for shifting students. 

If a teacher feels that a student is very v;eak in composition fund- 
amentals, he may request that the student in question receive special 
tutorial help with a graduate assistant. The help is provided free of 
charge to the student as part of the Intensive Writing Center and its 
basic aim is to have the student work on essay problems on a one to one 
basis with a graduate student in the Department. In many cases, students 
seeking this help have benefited immensely; and in those cases where 
Students have failed to improve so that they maintain a C average, they 
are then further required to formally enroll in English 238, which 
extends the basic concepts of the tutorial program except that a student 
is required to remain enrolled until his ability is up to a C average or 




better. 
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Aside from the tutorial program, there are two other means by which 
misplaced students may be changed: the first of these la to shift a 
student from one sequence to another depending upon his ability as per- 
ceived by the tnetruetor. What thii means 1# that a atudemt enroUed In 
English 111, the first quarter course, who shows high achievement may be 
moved to English 102 the second quarter at the suggestion of the instruc- 
tor. Likewise, a student who proves to be weak in 101 may be moved down 
to 112 the second quarter. The second option open is for an exceptional 
student in either sequence to be awarded Advanced Placement after one or 
two quarters of composition. Thus, every effort is made to insure that 
each student will receive the maximum benefit and attention that is 
possible while enrolled in the freshman composition program. 

The individual syllabus for composition sequence (copies of 

each follow on pages seven through fourteen) is designed around general 
principles of writing which the Department of English at Western feels 
are the Important concerns of a composition course. Each syllabus is 
designed to meet the needs of the sfeclfic students enrolled with the 
overall aim being to have the students effectively written 

essay . " 

The English 111 syllabus Is dsslgned to have the studeiita o>.-8«i<»e 
their thoughts in a logical manner, dlacuas a particular topic fully and 
completely, become .ware of the many atyllatlc procsdursa Incorporated In 
a well-written esaay, and to know the principles of mschanlcs which 
Include punctuation, sentence development, gnomatlcal elements, etc, 

TO meet this slm,s basic rhetoric book Is used to help the student not 
only learn thsss principle, but also to show him ..ampls. «id give him 
sxercl.es designed .round the us. of these fundamental: Idea. . The 112 
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course incorporates a small amount of literature wliich is used, not to 
teach literaior i4eae» hut for tiie purpose of 

supplementary reading material from which essay topics may be taken. In 
addition to these readingep an essay reedsr is also iaoorposnted to 
provide the student with complete examples of the essay forms being dis- 
cussed in a particular course. The third quarter of the 111 sequence is 
designed to teach the student the methods of general research and to 
properly write a research paper. - Literature is again used in 113 for 
the sole purpose of providing the student with a fruitful area from 
which an Interesting topic for research may be taken. 

Like the 111 sequence, the 101 sequence utilizes a rhetorical guide 
and an essay reader as the basic course books from which the students 
work. The chief aim of 101 is much like that of 111 except that more 
extensive work is done is auch areas as persuasion, logic, and writing 
about literature. Thus, students enrolled in the 101 sequence are 
considered to be more advanced than students in English 111 and in 
that regard the work is progressively more demanding of the 101 sequence 
students. 
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Outline for English 111 Sequence 
In Freshman Composition 



C^ neral Information ? 

1. Students are assigned to the 111 sequence on the basis of tests given 
during the summer to determine the student’s writing competence at that 
time and on high school performance* 

2. During the fall and winter quarters Instructors in 111 sections should 
Identify students working at a level which qualifies them for enrollment 

In the 101 sequence and recomnend their transfer at the end of the quarter, 

3. If the instructor so chooses he may refer students who are performing at 
a low level to Dr* Lindsey^ who will invite these students to participate 
in the Intensive Writing Center. 

4* Freshman Composition instructors are encouraged to propose plans for 
experimental': sect Ions in any quarter of the freshman sequence to Dr, 

Lindsey and the Freshman Composition Committee* It is the policy of 
the Department to invite experimentation whenever possible. 

General Principles ? 



I, Atm of the Course 
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THE GOAL OF THE FRESHMAN COMPOSITION PROGRAM IS TO ENABLE THE STUDENTS TO 
PRODUCE AN EFFECTIVEI*Y WRITTEN ESSAY. IF THE TEACHER APPLIES THE FOLLOW- 
ING QUESTIONS TO ANY ESSAY, HE WILL GUIDE THE STUDENTS TO THIS GOAL* 

1* Content: Does the student discuss a significant subject intelligently 

and completely? 

A. Does he have an adequate knowledge of his subject? 

B* Does he avoid errors in logic? 

2. Organization: Is the method of presentation clear and effective? 

A* Is the central idea (or thesis) clear? 

B* Are there ample details and examples to develop the. central idea 
(or thesis)? 

C* Are the ideas developed in logical order? 

1* Are the paragraphs placed In natural and logical sequence 

within the whole? 

2. Are the sentences placed In natural and logical sequence, from 
premise to conclusion, within the paragraphs? 

3* Are the individual paragraphs sufficiently developed through 
use of specific and concrete examples, where needed? 

D. Are the transitions adequate? 

E. Are ideas given the emphasis required by their importance? 

3* Style: Does the essay Incorporate effective stylistic procedures? 

A. Is the diction accurate, well-choeen, end sufficiently varied? 

B. Is the sentence structure effective? 

1. Is there appropriate variety in sentence structure? 

2* Are uses of subordination and coordination appropriate? 

C* Is there appropriate variety in ways of developing paragrephe? 

14 
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W.B. CiLucernlng mechanics. Is the essay reasonably free of idiomatic 

difficulties, fragments, run-on sentences, comma splices, faulty 
parallel structure, mixed constructions, dangling modifiers, and 

errors of agreement, case, and verb forms? Is the paper reasonably 
free of spelling errors and punctuation errors? 

Since the aim of the three-quarter sequence is to Improve the 
student’s ability to express his ideas clearly and forcefully in 
writing, a satisfactory level of proficiency in writing is the basis 
for judging the student* a success in the courses. Thus, his final 
grade should be based mainly on his performance In themes. 

n. General Nature of the Course 

The goals mentioned, concerning the writing of an effective essay, are thoae 
which we hope each student will achieve In the Freshman 111, 112, 113 se- 
quence. A variety of good teaching styles may be used to attain these goals, 
and each teacher Is free to use any teaching method which he feels best meets 
his students’ needs. But keep In mind that 112 and 113 teachers will expect 
that students have mastered the material and skills taught in the previous 
quarter or quarters. Remember also that the first need we are respon.^lble 
for gratifying Is the students’ need to write quality expository prose. The 
111 sequence Is designed to examine various inodes of exposition at work — per- 
sonal opinion, essay discussion questions » special considerations when writing 
about literature, and research papers. The unifying factors in all expository 
writing are that the papers represent the students’ ability to organize Infor- 
mation that they desire to present to a r6id3.ng audience. Accordingly, all 
expository writing, regardless of its type, requires clarity, logical and 
effective organization, and thorough and accurate presentation. 

This Is not to say that either narrative or descriptive writing has no value. 
Undoubtedly these forms of discourse are beneficial In helping the students 
to see the Importance of sufficient, vivid details to produce good writing. 
However, much of the students’ writing experience In secondary school has 
emphasized description and narration, and they handle these forms reasonably 
x^ell. But since the purpose of the 111 sequence Is to give students practice 
in writing themes which are organized and developed around a central Idea, 
description and narration are significant only as they lead to competence in 
handling exposition. 



SPECIFIC AIMS AND CONTENT OF ENGLISH 111 

The 111 course focuses mainly on the content and organization of student 
themes. Nhat should be kept In mind Is that students should be writing full 
length themes by the end of the quarter. Whether the teacher approaches the Idea 
of the whole theme first, or paragraphs first, or sentences first, or what have 
you, Is Important only In that the teacher should use the best approach for his 
students In accordance with his most effective way of presentation. The chapters 
which should be covered In Guth’s Words and Ideas are chapters 1, 4. 5, 11, and 13. 
These chapters deal with exploring and focusing the subject of a theme, with intro- 
ducing the Idea of a thesis — or central idea — and support, with the themes of 
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process, classification, comparison and contrast, and definition, with writing 
papers of opinion anchored to facts, with r^wiys of organizing and revising para- 
graphs, with developing variety in sentence structure, and with eliminating awkward 
sentence constructions. The other chapters of the book exclusive of chapters 6, 7, 
8, 9, 10— which will be covered in 112 and 113— are free for the teacher to use as 
she/he wishes to meet the students' needs in attaining competence in writing* 

The essays in the Kakonis text , Strategies in Rhetoric^ may be used as models 
for class discussions concerning the rhetoric theories, ideas, organization, and 
skill of the essay writers as they exemplify the skills which we are trying to 
develop in student writing. In addition to the rhetoric mode that Guth proposes, 
Kakonis adds analysis, analogy, and cause and effect. The teacher may choose to 
con^'dlt each of these rhetoric approaches as she/he teaches the essay. The entire 
book, exclusive of "Myth and Symbol," pp. 397 - 455, may be used. 

Texto: Hans Guth, Words and Ideas (Ch. 1, 4, 5, 11, & 13) 

l^akonis and others. Strategies in Rhetoric (pp. 1 - 396) 

Writing AssignmentJ? : Each teacher should assign writing that approximates a 

minimum of 5 substantial essays. 



SPECIFIC AIMS AND CO NTENT OF ENG LISH 112 

The 112 course is a continuation of the foundations of good Tirritlng covered in 
111, but 112 examines the specific topics of argumentation and persuadon, of tone 
and style, of writing about literature, and of the practical prose forms of essay 
examination (Ch. 6, 7, 10, and 19 in Guth, Words and Ideas ). At this point of the 
sequence consciousness about improving and polishing writing style probably will 
■develop in students, and thus emphasis on Chapter 8 ("Tone and Style") of Words 
and Ideas 1> strongly suggested. Keep in mind that the teacher should not hesitate 
to review material in Words and Ideas covered during the first quarter, if the 
class' needs demand such review. 

The essays in Strategies in Rhetoric in tUe section "Myth and Symbol" (pp. 397 - 
455) again may be used as models for di/icusslon and critl^*'lsm. 

The teacher should also choose two of the following literature forms to provide 
reading material for students to base writing themes about literature upon: a 

short story anthology, a novel, a play. 

Texts: Guth, Words and Ideas (Ch. 6, 7, 8, 10, 19) 

Kakonis, Insight , "Myth and Symbol" pp. 397 - 455 

Teacher's choice of 2 ^ of the following 3: a short story anthology, a novel, 

a play. 

Wj. Iff tig Assignments: Each teacher should assign at least 1 paper on argumenta- 

tion, 1 on persuasion, and 1 on writing a theme about 
literature. The other two themes, which would make a 
total of ^ substantial themes, minimum, are lei't to the 
teacher's discretion as to whether he wants a majority of 
argumentatatlon, persuasion, or literature themes for the 
quarter. 
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SPECIFIC AIMS AND CONTENT OF ENGLISH 113 



Since the student was introduced to specialized forms of writing in 112, the 
113 course continues the study of speclsllzed writing fonos end exmlnes and em- 
phasizes the writing of the research paper, writing essays based on research, and 
using the library. Chapter 9 in Words and Ideas contains a thorough presentation 
of the research process and writing of the research paper. 

Each teacher should also select a topic of his or her choice. Every student, 
then, will research and write about an aspect of this total problem. It is pos- 
sible to use the library for research, but the teacher may choose to go to case- 
books instead. If casebr >ks are necessary each teacher will be asked to select 
the casebooks that he requires the student to buy. Other than the research, 
students may be asked to do other papers (short ones) based on the topic, if the 
teacher so desires. 

Further plans will be forthcoming after further communications with the Library 
in the Fall of 1971. 

Texts s Guth, Words and Ideas (Chapter 9) 

A maylmum of ± paperback books of the teacher’s choice. If more than 
6 are needed, special permission should be obtained from the Freshmen 
Composition Committee. 

Writing: A research paper and other papers based on the research to approxi- 

mate the equivalent of ^ substantial essays. 
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Outline for English 101 Sequence 
in Freshman Composition 



General Info rmation 

1. Students are assigned to the 101 sequence on the basis of tests given 
during the summer to determine the student’s writing competence at that 
time and on high school performance. 

2. During the fall and winter quarters instructors in 101 sections should 
identify students working at a level which qualifies them for enroll- 
ment in the 111 sequence and recommend their transfer at the end of 
the quarter. 

3. If the Instructor so chooses he may refer students who are performing 
at a low level to Dr. Lindsey, who will invite these students to parti- 
cipate in the Intensive Writing Center. 

4. Students who distinguish themselves in English 101 and who demonstrate 
that they posses the skills to be taught in the sequence may be awarded 
advanced placement upon the recommendation of the Instructor. 

5. Freshman Composition Instructors are encouraged to propose plans for 
experimental sections in any quarter of the freshman sequence to Dr. 
Lindsey and the Freshman Composition Committee. It is the policy of 
the Department to invite experimentation whenever possible. 



General Pri nci ples : 



I. Aim of the Course 

THE GOAL OF THE FRESHMAN COMPOSITION PROGRAM IS TO ENABLE THE STUDENTS TO 
PRODUCE AN EFFECTIVELY WRITTEN ESSAY. A CHIEF MEANS TO THIS END IN 102-103 
IS WRITING ABOUT LITERATURE, IF THE TEACHER APPLIES THE FOLLOWING QUESTIONS 
TO AN ESSAY, HE WILL GUIDE THE STUDENTS TO THIS GOAL. 




1. Content: Does the student discuss a significant subject Intelligently 

and completely? 

A. Does he have an adequate knowledge of his subject? 

B. Does he avoid errors in logic? 

2, Organization: Is the method of presentation clear and effective? 

A. Is the central idea (or thesis) clear? 

B Are there ample details and examples to develop the central idea 
(or thesis)? 

C. Are the ideas developed in logical order? 

1. Are the paragraphs placed in natural and logical sequence 
within the tidiole? 

2. Are the sentences placed in natural and logical sequence, from 
premise to conclusion, within the paragraphs? 

3. Are the individual paragraphs sufficiently developed through 
use of specific and concrete examples, where needed? 

D. Are the transitions adequate? 

E. Are Ideas given the emphasis required by their Importance? 

18 
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Styles Does the essay Incorporate effective stylistic 'procedures? 

A. Is the diction accurate, well-chosen, and sufficiently varied? 

B. Is the sentence structure effective? 

1, Is there appropriate variety in sentence structure? 

2. Are uses of subordination and coordination appropriate? 

C. Is there appropriate variety in ways of developing paragraphs? 



N.B. Concerning -lechanlcs, is the essay reasonably free of idiomatic 

difficulties, fragments, run-on sentences, comma splices, faulty 
parallel structure, mixed constructions, dangling modifiers, and 
errors of agreement, case, and verb forms? Is the paper reasonably 
free of spelling errors and punctuation errors? 



Since the aim of the three-quarter sequence is to Improve the 
student's ability to express his ideas clearly and forcefully in 
writing, a satisfactory level cf proficiency in w riting is the 
basis for judging the student's success in the courses. Thus, his 
final grade should be based mainly on his performance in themes. 



II. General Nature of the Course 

The goals mentioned above concerning the writing of an effective essay 
along with developing the skill of writing about literature are tnose which 
hope each student will achieve in the Freshman 101, 102, 103 sequence. 

A variety of good teaching styles may be used to attain these goals, and 
each teacher is free to use the teaching methods which he feels best meets 
his students' need to write quality expository prose. The 101 sequence begins 
with the development of the effective essay. After these skills are 
taught, there is careful consideration of siting about literature, and 
this is logically followed by research on a literary topic. The unifying 
factors in all the expository writing are that the papers represent the 
students' organization of information that they desire to present to a 
reading audience. Accordingly, all expository writing, regardless of its 
type, requires clarity, loi;lcal and effective organization, and thorough 
and accurate presentation. 

This is not to say that either narrative or descriptive writing has no 
value. Undoubtedly these forms of discourse are beneficial In helping the 
students to see the Importance of sufficient, vivid details to produce 
good vjrlting. In this sense, description and narration play key roles in 
developing good writing. However, much of the students' vnrltlng experience 
in secondary school has emphasized description and narration, and they 
handle these forms reasonably well. But since the purpose of the 191 
sequence Is to give students practice in writing themes which are organized 
and developed around a central idea, description and narration are signifi- 
cant only as they lead to competence in handling exposition. 



SPECIFIC AIMS AND CONTENT OF ENGLISH 101 

The 101 course focuses primarily on the content and organization of logically 
developed student themes. The students should be writing full length themes by 
the end of the quarter. Whether the teacher approaches the idea of the whole 
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theme first, or paragraphs first, or sentences first, is only Important In that 
the teacher should use the best approach for his students in accordance V 7 ith his 
most effective v^ay of presentation. The chapters which should be covered In 
Guth’s yyprds and Ideas are Chapters 1, 4, 5, 6, 7, 11, and 13. These chapters 
deal with the followings exploring and focusing the subject of a themes intro- 
ducing the idea of a thesis or central idea and support? studying the themes of 
process, classification, comparison and contrast, and definition? writing papers 
of opinion anchored to facts? studying logic and persuasion? organizing and 
revising paragraphs? developing variety in sentf-'.ce structure; and eliminating 
awkward sentence constructions. Exclusive of 8 and 10, the other chapters of 
the book are free for the teacher to use as he wishes to meet the students' 
needs in attaining competence in writing. 

The essays in the ICakonls text. Strategies in Rhetoric , may be used as 
models for class discussions concerning the rhetoric theories, ideas, organiza- 
tion, and skill of the essay writers as they exemplify the skills which we are 
trying to develop in student writing. In addition to the rhetoric modes that 
Guth proposes, Kakonls adds analysis, analogy, and cause and effect. The teacher 
may choose to consult each of these rhetoric approaches as she/he teaches the 
essay. The entire book, exclusive of ’Hyth and Symbol,” pp. 397-455, may be 
used. 



Texts; Hans Guth, Fords and Ideas (Chapters 1, 4. 5. 6. 7. 11, & 13) 
Kakonls, Strategies in Rhetoric (Pages 1-396) 

Writing Assignments: Each teacher should assign writing that is equivalent 

to a mlnlnum of 5 substantial essays. 



SPECIFIC AIHS OF ENGLISH 102 



The 102 course is a continuation of the foundations of good writing covered 
in 101, but 102 examines the specific topics of tone and style as well as writing 
about literature, specifically short papers on literary topics. At this point 
of the sequence, consciousness about improving and polishing writing style prob- 
ably will develop in students; thus, emphasis on Chapter 8 ("Tone and 5;tyle") of 
Words and Ideas xs strongly suggested. Keep in mind, also, that the teacher 
should not hesltc?te to review material in Words and Ideas covered during the 
first quarter If the class' needs demand such review. Cahpter 10 in Words and 
Ideas concerns writing about literature, particularly the critical review. "Myth 
and Symbol” in Kakonls' Strategies in Rhetoric will also be useful in teaching 
writing about literature. This study Xi/lll be continued as each teacher selects 
various generic forms which should lead to the development of writing about 
literature, it becomes obvious that 102 is not a literature course; rather, 
literature is used as a source about which students write. The fundamental con- 
cern remains composition. 

Since many of the students will enroll in literature survey courses at a 
later date, exposures to a number of genres night be profitable if a teacher 
feels he can integrate them effectively In the writing program. 




Texts; Hans Guth, Words an d Ideas (Chapters 8 & 10) 

Kakonls, Strategies in Rhetoric . 'Myth and Symbol," (Pages 397-455), 

Writing; Each teacher should assign writing that is equivalent to a minimum 
of 5 substantial essays. o|*k 
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SPECIFIC APIS CONT^ OF ENGLISH 103 

Thus far the student has considered the writing process In general and has 
focused on writing about literature. The process continues and culminates in a 
research paper based on literary study. This research paper based on a literary 
topic planned by the teacher td.Il be the logical conclusion of the consideration 
of writing about literature. Chapter 9 in Words and I deas contains a thorough 
presentation cf the research process and writing of the research paper. Every 
student will research and tnrite about an aspect of the total problem chosen by 
the leacher. It Is possible to use the library for research, but the teacher 
may choose to go to casebooks instead. If casebooks are desired, each teacher 
will select the casebook that he requires the students to buy. 

Texts: Guth, Words and Ideas (Chapter 9) 

A maximum of ^ paperback hooks:; of the teacher's choice. If more than 
6 are needed, epeclal permission should be obtained from the Freshma'^ 
Composition Committee. 

Writing: A body of writing to approximate at least the equivalent of _5 

substantial essays. (The suggestion is that there perhaps be ^ 
short critical papers and a research paper.) 
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The Problem Defined 

Since programs in freshman composition are vulnerable to criticism, 
especially today when the watchwords of most educational circles seem to 
be "relevancy" and "accountabllitj^V*. it tskes little effort to begin 
attacking various course offerings in composition on the collegiate 
level. Such has been the case at Western Illinois University. For 
q*iite some time various groups have brought the freshman con^osition 
program into their line of fire as being a curricular offering that 
achieves very little and could be easily eliminated. The bulk of the 
evidence against maintaining a freshman writing program appears to be 
centered in two areas, namely s the group’s judgements are based on 
seeing the performance of a limited number of students who have not 
made any significant writing improvement or else they use the tradition- 
al scapegoat for eliminating the program that Kitzhabcr quotes in 
Themes , Theories , and Therapy ; 

‘It is our assumption,* says the chairman at one . . . college, 
’that students entering college should have acquired this 
skill [writing] In secondary school and that application and 
development of such skill is best handled in terms of the 
disciplines in which they actually have to do their writing.’^ 

Unfortunately, this view is not supported by the research done in the 

field as evidenced in the study done by Mathews and Scouffas (34-1952) 

who conducted a follow-up study of entering freshmen in 1951-52 and 

noted that "the striking fact established by comparison of the present 

record with the earlier is the increase in the percentage of students 

marked for errors in almost all individual categories.”^ Ttiere Is 

little contemporary evidence to the contrary. 

In regards to maintaining freshman cooq>o8ltion courses Kitzhaber 

maintains that they serve a dual function for the university. He says 
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that composition functions in a "service" and a "liberal" capacity. The 
service aspect of composition is that "the course exists to provide 
immediate therapy for students whose academic future is clouded by their 
inability to manage the written form of English with reasonable ease, 
precision, and correctness."^ The second function of composition is 
not of a practical nature but one of liberal, intellectual competency 
and training. "This arguemcnt assumes that the primary purpose of 
the course is to focus the student's attention on fundamental principles 
of clear thinking and the clear and effective written expression of 
that thinking. . . 

This, then, is the situation which prompted this writer to conduct 
a study into the effectiveness of freshman conq>osition at Western Illinois 
University. It seems that the one outstanding attribute voiced by the 
Department of English in favor of the three quarter sequential program in 
composition is that students ^ improve their writing abilities by being 
taught the needed skills of effective writing. If this is not the case, 
the groups who oppose the retention of freshman composition may be justi- 
fied in thc.?r feelings towards such a course offering. Yet to simply 
state that students will or will not improve without having any empirical 
evidence to support either point would also appear to be an equally vast 
generalization made simply to fight for or against keeping the program 
under question. It is necessary, then, that some type of study be 
undertaken to determine with some degree of accuracy just what does 
occur: in the freshman composition courses as they are now being taught. 

With all thcae points in mind, the problem as it now stands seems to 
be whether or not there is any significant difference, In terms of student 
writing improvement, after taking freshman composition. Prior to a 
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freshman student's initial enroliment at Western in the fall, he is 
required to write a diagnostic essay as one measure of plactnsnt in the 
proper composition sequence. This diagnostic essay is then rated and the 
essay score along with other scores is computerized to establish the 
student's placement in composition. The placement procedures are rela- 
tively accurate because they utilize, in addition to an actual writing 
sample, class rank, ACT score overall, ACT score in English, and high 
school recommendations and grades. 

The problem to be examined and studied, then, will be to ». 

determine if a significant difference exists between the summer essays 
(pte— test) and essays written after one and one— half quarters of compo- 
sition (post-test) for students enrolled in the 111 or the 101 sequence 
as incoming freshmen in the Fall quarter of 1971 at Western Illinois 
University, 

The Need for this Study 

This study is needed in order to empirically confirm whether or not 
the freshman composition program, as it is presently being admlnlstere'^ 
achieves the curricular objectives set forth in the syllabus for each 
separate sequence. Further, it is necessary to point out any areas of 
weakness that exist in the program so that corrective measures may be 
taken in the future. 
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Assumptions and Limitations 

X. Assumptions 

1. It Is assumed that Instructors taught freshman composition 
In accordance with the guidelines established in the syl- 
labus for each sequence. 

2. It Is assumed that the effects of age, sex, and socio- 
economic background are randomly scattered in the sample 
population so as to have no significance on the results. 

3. It Is assumed that the essay raters graded the post-test 
essays under the same approximate conditions as they graded 
the pre-test essays. 

II. Limitations 

1. The generalizations made in this study are applicable only 
to those areas measured in the student's compositions 
according to the Essay Evaluation Sheet. 

2. The generalizations made in this study are applicable only 
to the progress made by freshman students during the first 
one and one-half quarters of the composition sequence. 

3. The generalizations made in this study are limited to 
freshman students enrolled in cocposltlon at Western 
Illinois University. 

Statement of the Research and Null Hypothessjt 
!• Research Hypotheses 

1. There will be a significant difference pre and post in terms 
of writing Improvement as measured by the Standard Essay 
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Evaluation Sheet, for students who have taken one and one- 
half quarters of composition, In the areas of content, 
organization, style, mechanics, and overall score. 



II. Null Hypothese s 

1. There will be no significant difference pre and post for each 
student in the area of content. 

2. There will be no significant difference pre and post for each 
student in the area of organization. 

3. There will be no significant difference pre and post for each 
student In the area of style. 

4. There will be no significant difference pre and post for each 
student in the area of mechanics. 

5. There will be no significant difference pre and post for each 
student in the overall essay score. 

6. There will be no significant difference pre and post for 
English 111 in the area of content. 

7. There will be no significant difference pre and post for 
English 111 in the area of organization. 

8. There will be no significant difference pre and post for 
English 111 in the area of style. 

9. There will be no significant difference pre and post for 
English 111 In the area of mechanics. 

10. There will be no significant difference pre and post for 
English 111 in the overall essay score. 

11. There will be no significant difference pre and post for 
English 101 in the area of content. 

12. There will be no sigjnlf leant difference pre and post for 
English 101 in the area of organization. 

13. There will be no significant difference pre and post for 
English 101 in the area of style. 

14. There will be no significant difference pre and post for 
English 101 in the area of mechanics. 

15* There will, be no significant difference pre and post for 
English 101 in the overall essay score. 
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16. There will be no significant difference pre and post for the 
group in the area of content. 

17. There will be no significant difference pre and post for the 
group in the area of orgorization. 

18. There will be no significant difference pre and post for the 

group in the area of style* 

19. There will be no significant difference pre and post for the 
group in the area of mechanics. 

20. There will be no significant difference pre and post for the 
group in the overall essay score. 

21. There will be no significant difference pre and post in yes/ 
no responses to question II A on the Essay Evaluation Sheet. 

22* There will be no significant difference pre and post in yes/ 
no responses to question II B on the Essay Evaluation Sheet. 

23. There will be no significant difference pre and post in yes/ 
no responses to question II C on the Essay Evaluation Sheet. 

24. There will be no significant difference pre and post in yes/ 
no responses to question II D on the Essay Evaluation Sheet. 

25. There will be no significant difference pre and post in yes/ 
no responses to question II E on the Essay Evaluation Sheet. 

26. There will be no significant difference pre and post in yes/ 
no responses to question III A on the Essay Evaluation Sheet. 

27. There will be no significant difference pre and post in yes/ 
no responses to question III B on the Essay Evaluation Sheet. 

28. There will be no significant difference pre and post in yes/ 
no responses to question III C on the Essay Evaluation Sheet. 

29. There will be no significant differences between the group 
mean differences for the areas of content, organization, 
style, mechanic, and overall score. 

30. There will be no sl(pilflcant differences between the group 
mean differences on yes responses for questions II A, II B, 

II C, II D, HE, III A, III B, and III C. 
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Definition of Terms 

In any type of research » but especially experimental research, there 
is a need to define a variety of terms used by the experimenter. The 
need for cl?ar definitions is important, for without them the entire re- 
search project would lack clarity and hinder; the possible replication of 
the experiment. Defined below are those terms utilized by this writer 
during the course of studying freshman writing Improvement. The terms 
defined are those deemed essential for replication and understanding of 
this particular study. 



Content : As Interpreted by the Department of English and the 

essay raters used in this experiment, content concerns a writer* s 
handling of the material to be written about. Three primary 
factors are considered: Does the student discuss a significant 

subject? Does he discuss it intelligently? Does he discuss 
it completely? 

2. Duncan *s Multiple Range Test : A technique which allows a com- 

parison of groups of means. By comparing the means in pairs, 

etc,, it is often possible to determine precisely any 
significant differences between the group of means being ana- 
lyzed . 

3. Freshman Composition Program : The program is composed of num- 

erous areas with each one designed to meet a specific need as 
defined below. 

A. Ill , 112 , 113 Sequence : Designed to be the basic program 

in freshman composition; this sequence strives to aid fresh- 
man students in developing and expressing their ideas in 
clear. Idiomatic English. 

®* 19 ^* ^03 Sequence ; Designed primarily for freshman 

students who have shown special ability in English according 
to the evaluation procedure used by the department of English 
which Includes class rank and ACT scores overall as well as 
in English. The course Involves the student in more writing 
about literature than is found in the 111 sequence. 

C, Intensive Writing Center ; Directed writing and Indlvtdr 

ual tutoring. The student proceeds at his own pace for one, 
two, or three quarters of tutoring according to need, until 
his writing is at least at the C level. This course is 
offered to those students who need extra help while enrolled 
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in composition and also to students who fail to maintain 
a C average after doiupleting three quarters of composition. 

D. Advanced PlacemerU: Students Who show themselves to be 

superior writers on the placement test or by passing the 
proficiency exam given each quarter or by Instructor recom- 
mendation, may be exempted from enrolling in freshman comp- 
osition and In turn receive credit for one, two, or three 
quarters of English. 

4. Level of Si gnificance ; A judgement based on the Improbability 
of a certain idea, concept, or phenomena occuring by chance. 

A hypothesis is rejected (null hypothesis) when statistical 
significance confirms that the findings do not occur by chance. 
As an example, if the confidence level (level of significance) 
is set at five .per cent, otherwise known as the .05 level of 
confidence, as a criterion for rejection, inotherwords this means 
that the probability of a particular phenomena occuring by 
chance would be five times out of one hundred. 

5. liean and Mean Difference ; The mean is simply the addition of 
all the scores on a particular test and then the division of 
that total by the number of scores reported. The mean dif- 
ference is when the mean for one set of scores is subtracted 
from the mean of a second set of like scores. The resulting 
difference is reported as the mean difference. 

6. Mechanics; Simply that area of conposition concerned with 
spelling, grammar, idiomatic expression, and punctuation. 

7. Organization; Organization concerns the effective development 

of ideas so that the paper has a beginning, middle, and an end. 
It primarily involves the following questions: 1) Is the 

central idea clear?; 2) Are there ample details and examples to 
to develop the central idea?; 3) Are the ideas developed in 
logical order?; A) Are the transitions adequate?; and 5) Are 
the ideas given emphasis required by their importance? 

8. Standard Deviation ; An index of variability concerned with the 
dispersion of scores up and down and it is sensitive to the 
position of every score in a distribution. This statistic is 
utilized to compute the deviations of scores in a sample from 
the mean (average) score. 

9. Standard Essay Evaluation Sheet ; A form originally devised in 

California as the California Essay Rating Scale and later 
adopted by the . of English for the expressed purpose 

of formulating a standard criteria of measurement in evaluating 
newly enrolled freshman writing samples. The form is devised 
on an ordinal scale (see page 44 ) ranging from one to ten on 
the four areas of concern generally agreed upon as being the 
fundamental areas of composition by most professionals in the 
field (see Related Literature, page 26+) • 
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10. Student Writing Improvement : Measured In terms of the whole 

population under experimentation as well as In terms of Indiv- 
idual studantSy Improvement will be considered significant at 
the .01 level of confidence when statistically computed. 
Improvement will be measured In each of the five areas of con- 
tent, organization, style, mechanics, and overall score accor- 
ding to the Standard Essay Evaluation Sheet. 

11. Style; Tlie development of writing style so that uniqueness and 
effective stylistic procedures become apparent as students 
demonstrate sophisticated use of tropes, schemes, and other 
stylistic procedures to make their writing their own. 

12. Test of Significance ; In the case of this experiment the 
"T" test is a paired one which analyzes the pre and post scores 
for each individual and then derives its values using the mean 
differences of the data. By dividing the mean differences of 
scores by the square root of the standard deviation divided by 
the number of subjectSj the result is a value. Going to a 
Table of Critical Values of t and locating the t value for the 
particular test being done, the experimenter can immediately see 
if his results are significant and at what level the signifi- 
cance exists for the independent means studied. 
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Chapter 2 



REVIEW OF RELATED RESEARCH 

The main source bibliography used in this study was Research in 
Written Composition by Braddock, Lloyd-Jones, and Schoet. The biblio- 
graphy dravm up by them consisted of the 504 dissertations, studies, and 
articles thought to be the most useful out of over 1,000 such papers 
screened by them and their associates. Since the entries given by 
Braddock are from 1963 or earlier^ it vas necessary to consult other 
sources for more current material. Two such sources which proved to be 
helpful were the ERIC documents and a publication of the NGTE entitled 
Research in the Teaching of English . Though little research precisely 
as that done in this study was reported in the literature analyzed, 
a large portion concerning peripheral aspects of this experiment had 
been researched. Those concerns which have a close connection with 
this study are reported on below. 

The Concerns of Composition Courses : Methods and Objectives 

To say that the teaching of composition has many problems is not 
hard. IJuraerous studies [18,21,29]^ in this area bear that point out 
very well. Fellers (18-1953) feels we must extend the freshman comp- 
osition program beyond a one-year course in order to deal with the many 
problems properly and completely. Likewise, Gorrell (21-1965) states 
that administrative wanueverlng or teaching machines will not put an end 
to the problems of overloaded classrooms, overworked teachers, or poorly 
structured courses. Gorrell goes on to point out that freshman composi- 
tion must alter its content so that it does not merely become a repeti- 
tion of hig> school English but becomes, rather, an entirely new 
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experience to studente where ideas and concepts are isolated into Halted 
areas and dealt with completely, tamberts (29-1967) feels very much 
like Gorrell in that he senses most freshman composition courses are 
designed with the English major in mind and not the layman ^o needs in- 
struction in the basics of clear thinking.^ 

Beyond the general feeling that much careful consideration needs to 
be done in terms of what freshman writing courses are expected to accom- 
plish^ there have been a variety of studies done on what these courses 
should contain if positive results are to be expected from students. The 
Colorado study (10-1965) offers many helpful suggestions on course Input. 
One of the most important suggestions made was that composition be a 
sequential program because most students are not at the same ability 
level nor do they progress at the same pace.^ By offering a program 
designed sequentially > departments could better provide for all types of 
students with varying abilities in writing. Inasmuch as many profession- 
als in the field of composition have drawn up numerous objectives for 
courses in writing, five studies [9, 15, 29, 31, 33] appear to summarize 
the basic concerns scattered throughout much of the literature of this 
particular area. Cochrane (9-n.d.), Lauroesch (31-1956), and Marcus 
(33-1952) all feel that the important factor in any freshman program is 
to stress the basic skills of communication which include not only 
writing but also reading, speaking, listening, and understanding. 
Lauroesch extends this field even further by including work on a research 
paper along with a greater concentration on writing skills themselves 
which should be practiced by Increasing the amount of writing done in 
the classroom. Diederich [15] and others [8, 9, 14, 26 29, 43] have 

isolated what they believe teachers should stress in student writing 
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through learning and doing. These basic concerns fall into five main 
catagories: Ideas, which involves oonteiit, clarity, relevance, and dev- 

elopment; Form, consisting of organization and analysis; Flavor, which is 
basically concerned with style, interest, and sincerity; liechanics, the 
grammatical and punctuational aspects of writing; and Wording, concerned 
with word choice and arrangement. 

In order to carry out the objectives expressed throughout much of 
the literature, It is necessary for composition instructors to devise some 
type of methodology. Though few studies were designed to study methods 
of teaching alone (l..e., methodology was secondary to some other aspect 
being studied), important experimental studies by Becker (3-1960), and 
McColly (35-1963) are worthy of note because of their conclusions con- 
cerning methods of approach. 

Becker, in a State University of Iowa project, compared three methods 
of learning and teaching composition In an attempt to see if one method 
vras more effective than the others. The three methods used were called 
the "normal" method, which had students meet four times per week as 
they had been doing prior to the experiment; the "Bibliography" method, 
which reduced the number of class meetings and supplemented them with 
bibliographies of outside sijfpplementary readings; and the "kinescope" 
method, which used tapes of "experts" in various aspects of composition 
to present the main Ideas of writing,^ The conclusion drawn by Becker 
was that "students can acquire a knowledge of the principles of communi- 

p 

cation • . . equally well from each of the methods of Instruction tested."” 
It was interesting to note that the Instructors preferred the "normal" 
method of instruction because it allowed time to discuss the process of 
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writing with the students more than the other methods did which apparently 
is an important concern to composition tnetructors. The method voiced by 
McColly expresses a point of view that is often backed up by the litera- 
ture [3, 6, 9, 19, 29, 30, 32], Kis contention is that "the activity of 

q 

writing in and of Itself is fruitless" unless teacheis spend at least 
two or three days of "practical explanation, student practice, discussion, 
revising, rewriting, etc."^® In other words, it is important that 
students write but it is equally important to have students discuss and 
rework what they have written. 

Student Wrl ting Ability ; Problems , Solutions , and Improvement 

By and large, most studies [6, 8, 12, 19, 23, 28, 32] Involved with 

student writing Improvement have confirmed that students do really improve. 

Though little research Indicates that students Improve because of the 

amount of writing they do, a variety of studies find student Improvement 

due to a few particular causes, Buxton (6-1959) and others (19, 32] 

found student Improvement came as a result of ' essay revision^ more than any 

other factor. Along with this revision it has been suggested by Buxton 

that teachers should Informally discuss essay problems with students and 

ll 

offer constructive criticism for improving weak essays. 

Fellows [19] confirms Buxton’s findings by showing how one group of 

students that did not receive teacher criticism and correction failed to 

improve as much as a similar group of students who received both of 

these things as well as having to revise each of their essays. Keys 

(23-1962) found that having students do outside readings of essays was 

13 

a positive influence on their writing ability. Likewise, Christiansen^ 
(8-1965)^ in a writing frequency experiment^ found that reading helps 




29 



students improve In writing. In this study Christiansen had one group 
write twenty-four essays and a control group write eight essays with 
si!pplemental reading and discussion of prose essays. At the conclusion 
of the experiment^ both groups were sho^^ to Improve but neither one 
Improved significantly over the other. The conclusion drawn by Christ- 
iansen was that reading prose essays will do as much to Improve a 

14 

student’s writing as will writing three times as many essays. Though 

the literature does not support the idea of writing frequency being a 

means of student writing Improvement, La Brant (28-1953) feels that if 

students practice writing on subjects that interest them it will do 

more to improve their writing skill than will the traditional methods of 

15 

grammar drills, exercises, and writing workbooks. 

Though many studies optimistically point out that students can and 
do improve, there are a large number of studies (14, 16, 30, 34, 36, 43] 
that Indicate problem areas In student writing ability. Though no stu- 
dies analyzed felt that students, Instructors, or composition courses 
were to be blamed for student inability, many of them did indicate 
specific problem areas that should be corrected. Dressel (16-1952) , 

Lange (30-1948), and Mathews (34-1952) all felt that "students should be 
held responsible for effective composition in all of their courses"^^ 
and further that "every teacher must be responsible for the student’s 
expression of ideas, facts, and attitudes. Day (14-1943) took the 
problem even further by saying that "the weaknesses in compositions . . . 
suggest that high school teachers must place increasing emphasis tq>on 

the selection of significant material and upon organizing it logically 

18 

and presenting It effectively." 
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The solution provided by these studies, then, appears to be two- 
fold. Instnictora must be willing to work closely with students In dis- 
cussing and correcting thair essays while students must painstakingly 
revise what they write. In addition to this work within the classroom, 
instructors in all other academic fields must also demand student respon- 
sibility in writing as well as becoming more responsible themselves* 

f 

Essay Grading and Graders 

Next to research concerning student writing improvement and fre- 
quency of writing, studies concerned with essay grading and graders are most 
numerous. One of the classical studies of grading methods and practices 
was conducted by Hartog (22-1941) . Using a group of exa'nlners who graded 

seventy-five essays each, Hartog tested ^ whether oi not one of two 

grading procedures "iras superior to the other. The two grading* 
methods employed were the analytic, where a predetermined numerical 

scale was established for certain areas of the essay, and the general 
impression method, which allowed each examiner to evaluate each essay 
using his own general impression. The conclusion drawn was that "no 
greater precision of marking is obtained by details rather than by 
Impression. Since this study^ a similar one conducted by Wiseman 
(43-1949) drew the same relative conclusion. In direct opposition to 
the findings of these two studies are three studies by Braddock (4-1968), 
Cast (7-1939), and Coward (11-1952) which tend to indicate that the 
analytic mathod of grading "appears almost uniformly the best." The 
general consensus in favor of the analytic method is that such a method 
tends to reduce the Influence of grader bias by setting up a uniform 
grading scale to be used by all graders In a particular experiment or 
situation. 
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In addition to the studies which have analyzed the general Impres- 
sion method of grading against an analytic method » there is one study by 
Follman and Anderson (20-1967) which Investigated the reliability of five 



grading procedures — four of them analytic In -nature and the fifth one 
being of general impression. Using five rating groups ^ each one with a 
different rating procedure, Follman assigned each group a set of ten 
essays to grade. The five scales used were the "California Essay Scale," 
the "Cleveland Composition Rating Scale," the "Diederich Rating Scale," 
the "Follman English Mechanics Guide", and the one general Impression 
system known as the "Everyman Scale" where each rater graded the essays 
his own way.^^ The general conclusions drawn were that the Follman 
Scale had the highest correlation among individuals and for the group of 
raters while the California Scale also proved to be very reliable. The 
Cleveland Scale was the least reliable rating scale followed by the 
Diederich Scale. An Interesting conclusion drawn by Follman was that 
the Everyman Scale was also quite reliable when used by an individual 
In rating essays. 

In terms of grader variability. Smith (38-1969) found that among 

experts in the teaching of composition agreement in judgement, as - 

22 

measured by the test he employed, does exist and is reliable. Thomp- 
son, (40-1955), on the other hand, noted that within the English Depart- 
ment analyzed that variences in grading existed for the whole rhetoric 

23 

program in one out of three graders employed. Likewise, Anderson 
(l-1960)also noted that variances in grader marks existed In 78/4 of the 
cases studied, indicating, he felt, a need for a clearer criteria Of 
grading student essays. Tlds criteria seems to be to use an analytic 
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gr£idlng scale that all graders have used consistently. Such an assump- 
tion Is further enforced by Womsbecker (45-1955) who used three methods 
of grading essays and found that any of the methods was useful as long 
as the graders were consistent In their use of the methods employed. 

Obje ctive Tests versus E ssay Tests in Evaluating and Placi ng Students 

For decades English departments have fought bitterly over the issue 
of whether or not objective tests only, essay tests only, or a combina- 
tion of the two, should be used in evaluating and placing freshman stu- 
dents in composition. The landmark study in this area was done by 
Huddleston (24-1952) In an attempt to formulate some empirical results 
on the issue of cbjec^lve testing versus essay testing. Huddleston’s 
investigation involved five different types of institutions and divided 
the students Into sixteen classes of twenty- two to thirty- three persons 
each. The study used a variety of objective and essay measures in order 
to measure student writing ability and attempted to determine if one 
method was superior over another. It was found that the reliability 
coefficients of the Objective English section (.78) and of the Verbal 
Test (.96) were satisfactorily high to Indicate reliability of the test 
as a measure of student ability. The reliability coefficient for the 
Essay question, though, was only .62 and considered unsatisfactory.^^ 

The conclusion drawn by Huddleston was that it ’’hag been impossible to 
demonstrate . . , that essay questions, objective questions, or para- 
graph revision exercises contain any other factor other than verbal— 
these types of questions measure writing ability less well than does a 
typical verbal test.” Sutton and Allen (39-1964) drew the same basic 
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conclusion when they found that an objective CEEB test showed greater 
Improveioent In student ability p*e and post chan did an analysis of 
student essays. Likewise, Anderson (1-1960), after using an essay type 
test, concluded that student composition fluctuations were very high 
(78%) and because of this a clearer criteria of measure must be estab- 
lished. Though little research appears to favor the essay test as the 
sole measure of student writing ability, Eley (17-1955) argues strongly 
that the essay test be retained: 

There is no doubt that from some points of view we could 
find reasons for abandoning forever the essay test. 

Unfortunately, the corollary to this action is the decline 
in the teaching of the art of writing. This is a serious 
consequence both for the individual and for our society. 

The ability to use our language creatively is one of the 
last strongholds of the individual against a growing ten- 
dency toward conform! ty.^^ 

Though this arguement may be deemed an emotional one, it is sound and 
should be given strong consideration by those who wish to phase out 
the essay as a necessary measure of student ability with language. Since 
the amount of research done in this area is not extensive, it would seem 
plausible to investigate the problem more fully before a final decision 
to abandon the essay test in favor of an objective verbal test is made. 

S^immary of Related Research 

Numerous studies [18, 21, 29, 30, 34, 36, 43] have indicated large 
problem areas and areas of concern within the framework of composition. 
Three studies [18, 21, 29] indicate that some of the problems are asso- 
ciated with COOT‘S ^ , ocrifcCure, and administration, while others 

[14, I*"' ^-3 indicate that many of the problems are associat- 
ed with students and their ability to express themselves in 
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writing. In light of this, six studies [9, 10, 15, 29, 31, 33] have 
indicated some specific solutions to the problems of con^ositlon* 

Cochrane (9), Lauroesch (31), and Marcus (33) feel that the basic skills 
aspect of composition needs to be reemphasized, while Diedierich (15) 
and many others [8, 9, 14, 26, 29, 43] have pointed out specific areas 
that teachers should be concerned with in teaching students to write. 

In terms of methodology, the studies by Becker (3) and McColly (35) 
indicate that so long as the method of approach used is consistent there 
will be little significant difference between any methods adopted in 
departments . 

In terms of student Improvement, the majority of the research [6, 8, 
12, 19, 23, 28, 32] Indicates that students actually do improve. One of 
the most Important aids in student improvement was found by Buxton (6) and 
others [19, 32] to be due by and large to student revision of essays and 
teacher discussion and criticism. Another positive influence on student 
improvement is reading, as indicated by Keys (23) and Christiansen (8), 

One study indicates that drills and workbook exercises do little to 
promote student improvement in essay writing. Though students appear to 
improve^ some studies done [14, 16, 30, 34, 36, 43] have pointed to many 
problems that need to be overcome in other areas besides the English 
classroom. The greatest problem Indicated was that students are not held 
responsible in other courses for their writing proficiency [14, 16, 30, 
34]. 

Coincidental with student problems in writing have been a ntanber of 
studies indicating problems in essay marking and gradAr variability. 

Two studies [22, 42] have shown that no differences existed in grading 
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using an analytic method and an impression method. The opposite view- 
point, which indicated that the analytic method of grading was superior 
to the Impression method, was expressed in three studies [4, 7, 11] 
with the reason being that it provided uniformity among the graders. 
Follman»s (20) more involved study also supports this latter view. In 
terms of grader variability, evidence indicating reliable uniformity (38) 
as well as wide grader variability [1, 40] exists In the literature. 

The research on objective tests versus essay tests is split, 
Huddleston (24) Indicates that verbal tests are more reliable than essay 
tests and is supported in this view by two other studies [1, 39], Eley 
(17) presents a plausible arguement for the retention of essay tests. 

The general conclusions drawn from the research indicate that many 
problem areas exist in compos! tlon^ but ^ with the application of many 
worthwhile solutions^ student writing tends to improve. Along with prob- 
lems in composition in general, it has been found that a great deal of 
concern over grading procedures and grader variability exists. The gen- 
eral consensus is that an analytic method of grading will reduce grade 
fluctuations substantially while also raising the reliability of graders 
who consistently use such e. method. In terms of the reliability of 
objective tests over essay tests, the feeling is that more research 
needs to be conducted in this area before definite conclusions are formed. 

The best idea that is indicated would be to place students by using both 
an objective test and an essay test. 




36 



FOOTNOTES 



1. These numbers refer to the studies enumeraced in the bibliography, 
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Chapter 3 



METHODOLOGY 



Experimental Design 

Since this experiment was conceived at a time when no control group 
could be formed^ it was necessary to choose a one-group pre-test/post-test 
design. Yet, even with a design as limited as this one is, there is 
some control of internal validity. Van Dalen, in Understanding Educa- 
tional Research (41) says that the one-group design 

should be used only for preliminary research when the 
Independent variable 1-9 likely to produce a drastic effect , for 
this lessens the influence of extraneous variables; when the 
interval between T, and T2 is of brief duration, for there is 
less opportunity for history and maturation to operate; and 
when the dependent variable is relatively stable, that is, 
when it is not apt to change unless a deliberate effort is made 
to bring about change.^ 

The variables that Van Dalen brings out as being the most crucial to a 
design of this nature are history and maturation. History, where sub- 
jects become sensitized to what may appear on a pre-test prior to the 
post-test, has been controlled by having each student write on a differ- 
ent essay topic for the post-test than he had written on for the pre-test. 
The variable of maturity is considerably harder to control. There is 
a considerable amount of research which indicates that maturity does, 
indeed, influence student writing ability. The fact that the students 
involved in this experiment were placed in different surroundings, free 
from parental restraint^ can not be ignored as a factor helping to shape 
the maturing personalities of these students. Since the time span 
between the pre and post tests was relatively brief (less than six 
months) the effects of maturity on student writing would be leas 
significant than if this were a longitudinal study spanning a number 



of years. 
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Beyond the initial variables of history, maturation, and time. 
Van Dalen, goes on to mention that the one-group design could also 
be useful when one or two other conditions exist, namely; when 
the Independent variable may produce a drastic change pre and post 

M 

or thwn the dependent variable remains relatively stable. There 
is no way to determine, in advance, if a drastic change will occur 
between the pre and post-tests but it is possible in this experi- 
ment to maintain stability between the dependent variables of con- 
tent , organization, style, and mechanics. These dependent variables, 
previously defined in 'Operational Terms," were not changed for 
either the pre-test or the post-test. 

In general, then, the one-^. -'up pre-test/post-test design, 
though it does admit many faults in checking Internal and external 
validity, is applicable in formulating some generalizations about 
the significance of Freshman Composltlori at Western. 

Selection of the Population 

The initial Fall registration of new freshman students for the 
1971-1972 academic year was 3,098, and they served as the popula- 
tion universe. Of this number, 431 (12%) received Advanced Place- 
ment prior to the Fall term and were eliminated. The remaining 
2,667 students were placed in a composition course with 1,207 
(41%) enrolled in the 101 sequence and 1,460 (47% placed in the 
111 sequence. 

In order to arrive at a random population^ all the Essay Evalu- 
ation Sheets from the prevj siiimner placement test were gathered 
together. The sheets were no type of catagorical order so that 
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by using a table of random numbers each student received an equal 
chance of being chosen. It was desired to draw a double sample In 
order to allow for the probability that many students vrould fall 
to participate. Thus» the initial sample drawn contained 436 
subjects with the projected population to contain approximately 
200. The final population used consisted of 158 subjects with 
278 students not participating for various reasons (see page 44 
for complete population breakdown). 

Since the sample population was a random one, no attempt was 
made to stratify the population according to age, sex, socio-economic 
background, or race. These f^ictors were delimited as having little 
effect upon the dependent variables being studied. It may, there- 
fore, be assumed that these factcrs were randomized throughout the 
sample and any effect they may have exerted will be due to chance. 
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POPULATION STATISTICS 

Total Freshman population officially registered for Fall quarter 1971 3,098 
Students having received Advanced Placement and eliminated ^-»1 
Students placed in a composition sequence 2,667 



Initial random sample draxm for the experiment 

Students xvho failed to take the post-test 

Students who withdrew from school after one quarter 

Students who moved and did not receive notice of the post-test 

Students who failed to enroll in t\7o consecutive English courses 

Students who received Advanced Placement after one quarter of English 



436 

210 

32 

17 

10 

9 



Final sample population used in the experiment 



158 



Nxjmber of 
Number of 



students in the sample population enrolled In 
students In the sample population enrolled In 



101 sequence 
111 sequence 



77 
81 . 
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Essay Raters 

Aftar the post^tesi essays were written, th' 3 y were inatched up with 
each student's pre-test n‘^say evaluation sheet in order to determine which 
grader graded the pre*-test. This was done so that each grader would 
grade the same essays for the post- test as he had graded for the pre- 
test. Once the post- test essays were assigned to one of the three 
graders used, the same raters as on the pre— test, the students' names 
were masked to preserve anonymity. The raters were told to rate the 
post-test essays under as nearly the same conditions as they had done the 
pre-test essays and to use the same criteria of j'.Jgement as previously 
established. Thus, by having each rater grade the same student post-tests 
as they did for the pre-test and by further Instructing them to repli- 
cate the grading situation^ it was felt that some extraneous varis.bles 
Involved with marking and grader variability could, to a degree, be 
controlled. 

In terms of grader variability and reliability^ a test of significance 
was established to check on the consistency of the raters. The results 
of this test are reported and analyzed on page 53 under ''Reliability of 
Haters. " 

Measuring Inst rument Employed 

The measuring instrument used in this experiment is an adaptation of 
the California Essay Scale which was sho;m to be highly reliable by 
Follman (20) * The modifications made were the addition of a series of 
questions intended to aid the raters In determining the score for a 
particular area being considered. The Essay Evaluation Sheet used at 
Western (see page 44) is designed analytically which means that particular 
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areas of concern are rated in terms of an ordinal scale and a series of 
questions are added, to be circled "yes” or "no", to indicate further 
points of weakness in a particular essay. The areas of concern are those 
that both the Department of English at Western and numerous professionals 
[8, 9, 14, 15, 26, 29, 43] have found to be essential if an essay is 
to be considered effective. 
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EVALUATION — 35 POINTS 






1. Content: Does the student discuss a significant subject 

intelligently and completely? (10 points) 123456789 1C 


II. Organization: Is the method of presentation clear and 

effective? (10 points) 


123456789 1C 


. A. 


Is the central idea (or thesis) clear? 


YES 


NO 


B. 


Are there ample details and examples to develop the 
central idea (or thesis)? 


YES 


NO 


C. 


Are the ideas developed in logical order? 


YES 


NO 


D. 


Are the transitions adequate? 


YES 


NO 


E. 


Are Ideas given the emphasis required by their importance? 

YES 


NO 


Ill, Style: Does the essay incorporate effective stylistic . 

procedures? (10 points) 


123456789 1C 


A. 


Is the diction accurate, wexl-chosen, and sufficiently 
varied? « 


NO 


B. 


Is the sentence structure effective? 


YES 


NO 


C. 


Is there appropriate variety in vays of developing 
paragraphs? 


YES 


NO 



€unt'eiu/ 5 { Concerning mechanics, is the essay reasonably free of j. j j i j. i 
idiomatic difficulties, fragments, run-on sentences, / 

comma splices, faulty parallel structure, mixed con- 1 2 3 4 i 
St rue ♦•Ions, dangling modifiers, and errors of agree- 
ment, cose and verb forms? Is the paper reasonably 
free of spelling errors and punctuation errors? (5 points) 



TOTAL SCORE: — 
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Controlling Variaoles 

In Research Written Composition , Braddock <5) speaks of four 

variables that must be dealt with in any experiment studying composi- 
tion and essay evaluations* These four variables, called the "writer 
variable," the "assignment variable," the "rater variable," and the 
"colleague variable" are of such magnitude and Importance to warrant 
discussion and control in order to check any Influence they may exert. 

Studies by Kincaid (5-1953) and Anderson (1-1960) indicate that the 
majority of the students tested "showed evidence of composition fluc- 
tuation. Since this is the case for individual students, it Is 
Braddock* s contention that students be measured by the better of two 
or three papers and not on just one sample. Considering the design 
of this experiment^ such an idea Is impractical; so it is helpful to 
note that Kincaid's study concluded that "where a group of college fresh 
men is concerned, the average quality does not seem to be affected by 

3 

variations in the day*^to-day efficiency of individuals." Since this is 
the case in this study^ it may be concluded that some control is evident 
concerning the writer variable in terms of the group. 

Coincidental with the writer variable is the assignment variable 
the topic or topics given to students to write upon. Braddock felt 
that this variable had four distinct aspects to it, namely: "the topic, 

the mode of discourse, the time afforded for writing, and the exaroi.na— 
tlon situation."^ Concerning topics for students to write upon, the 
main problem Is to insure that the topics are not so abstract as to be 
tmfamillar with the entire group of subjects. All eight of the topics 
used in this experiment (see Appendix A, page 90^-), with the exception 
of "The Fun Picnic" which was later discarded, were kept as concrete 
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and broad as possible vjithout sacrificing clarity. Ali of the topics 
were relatable to nearly any socio-economic backgromd «nd they were all 
believed to provide adequate stimulation to the student v/rlters. The 
second area of consideration was the mode of discourse, l.e., descrip- 
tion, exposition, narration, persuasion, etc., under which the students 
were to write. Again, with the exception of "The Fun Picnic," all the 
topics used demanded a uniformly similar method of discourse which was 
centered around exposition. Little study has been undertaken in the 
area of writing time, Braddock’s third concern under the assignment 
variable. Braddock arbitrarily sets the time limits for college writers 
at approximately two hours In order to allow for revision and rexi^rlting. 
Unfortunately, the subjects in this experiment v/ere allowed only fifty 
minutes in which to write but most students finished before that time. 

The final area of concern is the examination situation. This variable is 
concerned with the close replication of the physical conditions that 
existed for both the pre-test and the post- test in order to control 
any extraneous stimuli that could possibly interfere with student 
x^riting performance. With the exception of weather and time of day, 
attempts were made to reolicate the examination situation for both tests. 
The conditions of lighting, room atmosphere, and student instructions 
were as nearly the seme as possible in both examination situations. 

To maintain the same instructions being received by all students so as 
to prevent any one student or group from receiving any ou.,alde stimula- 
tion, It was felt necessary to give each student printed copies of the 
instructions. 

The third major variable of concern in an experiment with composi- 
tion is the rater (grader) var-fable. Braddock feels that two major facets 
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cf the rater variable must be controlled if any unanimity is to be 
expected among the raters in an experiment. The first of these Is the 
rater's personal feelings tTlth the best means of control being to keep 
each student's paper anonymous so that the rater's familiarity with the 
student— *if it exists— -will not color his evaluation.^ One aspect of 
personal feelings that was not controlled ■ doncemed the post-tests. 
Since the raters were ax^are of the fact that they were rating post-test 
essays, room for rater bias to enter the experiment existed and could 
have possibly confounded the study. The second concern with the : 
rater variable is rater fatigue — the decrease in rater efficiency as the 
raters become tired. Since the three raters used w«re considered 
professionals, they should have maintained their efficiency especially 
since they were instructed against fatigue and also to grade the post- 
tests under the same conditions as possible that they graded the pre- 
tests . 

Braddock's final variable of major significance is the colleague 
variable; the possibility that the raters vary considerably from each 
other. This by controlling three main factors; 

on criteria, evaluation consistency, and rater ability. The 
three raters used In this experiment have all taught freslunan composi- 
tion for a ntjraber of years at Western and are, therefore, considered 
to be well qualified in rating the test essays both as individuals and 
as a group. Rater ability was further enhanced by using a clearly 
defined evaluation criteria for rating the essays. The method was 
an analytic one also employing a series of questions as guidelines in 
evaluation (see page 44). This method of grading is endorsed consist- 
ently throughout the literature by Braddock (5-1963), Cast (7-1939), 
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Diedrierich (15-1961), Follman (20-1967), and others who have consistently 
shown its superiority over other methods considered* The aspect of 
evaluation consistency is one that has been a problem in many eKperinien- 
tal studies. In order to check on the consistency of the raters used 
in this particular experiment^ a test of significance was done for each 
individual rater on his pre and post overall mean scores as well as a 
similar test for the group. A complete discussion of the statistical 
results is given on page 53., 

Data Collection 

Once the experimental population of 436 students had been drawn^ 
they were each screened through the Registrar’s records to insure they 
each had enrolled In an English course both In the Fall and In the 
Winter. This initial screening process eliminated fifty-one students 
(see page 41) who, had either dropped out of school or had failed to 
enroll in two consecutive English courses. 

After screening all students a letter was sent to the 385 
students still in the sample by the Director of Freshman Composition 
(see Appendix A, page 87 ). The letter Instructed each student to meet 
in a conference room In the Department of English on one of two specified 
evenings to take the post— test. Upon arriving at the conference room^ 
each student was handed a mimeographed set of instructions (see Appendix 
A, page 88 ) which 1) instructed the student to locate his blank essay 
topic sheet and blank evaluation sheet from the alphabetized <;tacks In 
the center of the room, and 2) Instructed the student to proceed to a 
designated room to write the post-test. Prior to the students arrival 
each of their pre-tests were matched up with a different topic; the group 
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of eight topics were the same ones used for the summer pre~test and 
contained the same set of specific Instructions, (see Appendix A, 
page 90-0. By having each student write on a different topic from the 
group. It was felt that the extraneous variable of history could be 
controlled adequately. The history variable concerns the presensiti- 
zing of subjects due to test material contained on a pre-test. In 
other words, if students wrote on the same topic for the post-test as 
they had for the pre-test, the possibility that their Improvement was due 
to previous knowlege from the pre-test rather than the variables actu- 
ally being tested exists. To further Insure an accurate replication of 
the pre-test on the post-test, each student's second topic was randomly 
selected from the group of eight and as nearly as possible the same 
number of topics from each group were used. This was done to insure that 
each subject did, Indeed, receive a new topic for the post- test and 
also it was felt that some extraneous variables concerning the raters 
and rating unanimity could be eliminated by choosing the same number 
of essay topics from the eight areas for the post-test as were found in 
the selected pre-test population. 

Once all the subjects had found their post-test topics and evalu- 
ation sheets and had gone to their respective rooms for writing, they 
were personally informed to begin writing by a member of the English 
Staff. Each student was allowed up to fifty minutes to write his 
essay and at the conclusion of the time period all remaining essays 
were collected. Each post-teat essay, along with its evaluation sheet, 
was then matched up with the pre'^test essay to determine which grader 
would receive which post-test to rate. Once this had been done, each 
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r^itcr given his set of post-test essays and grading instructions. In 
order to Insure anonymity of each student, the names were concealed and 
replaced with identifying numbers. 

One extraneous variable that needs attention here is that of student 
anxiety. Considering the students were being exposed to a rather unique 
experience, insomuch as being instructed to come and write an essay, it 
is quite possible that the students were generally apprehensive about 
the situation. Though little research had been conducted concerning 
anxiety and student writing ability, one study by Currie t (13) tends to 
indicate that student temperament and anxiety effect writing ability to 
a le^rser extent than do other extraneous things. If it is to be assumed 
that students were apprehensive and nervous during the post— test it must 
also be assumed they felt approximately the same during the pre-test, a 
time when they were caught up in the process of pre-registration and fam- 
iliarizing themselves with the caiapus. With no means available of 
measuring the significance of student anxiety, the experimenter is forced 
to assume that this extraneous variable’s effects were randomized on 
both the pre-test and the post- test. 

Test s to be Employed 

Once the raters had completed their ratings of the post-tests^ each 
student’s pre and post test evaluation sheets were attached and then 
ranked numerically foi ease of handling the data. Since the data gathered 
was both from pre-test and post-test scores^ it was decided that a paired 
"t" test of significance xg^ould provide thfe essential results needed. 

The paired "t” was used to test all the null hypotheses concerning any 
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significant differences » pre and posti on the areas of content, organic 

zation, mechanics, style, and overall score for the group rs a whole as 
well as for the 111 students and tU 102 students separately* Though 
the paired ”t*' was the main test employed, a Duncan's Multiple Range 
Test was also used to compare the mean differences of each of the areas 
in order to pin point more accurately where any dlf^'crences in the data 
existed. In addition to the analysis of the data concerning the specific 
areas above, a ”t*’ test was also employed to test any significant differ- 
ences among the graders. Likewise, the Duncan test was used to note 
any differences among the mern differences for the yes/no questions on 
the evaluation sheets. 
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1. Deobold B. Van Dalen, Understanding Educational Research , (New York: 

McGrav;-Hill Book Company, 1966), pp, 255-56. 

2. Braddock, op. cit. , pp. 6-11. 



3. Gerald L. Kincaid, "Some Factors Affecting Variations in the QuaHty 
of Students’ Writing," In Research In W ritten Composition , eds. 
Richard Braddock, et. al. , (Champaign: NOTE, 1963), p. 94. 
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cit. , p. 7. 



5. Ibid., p, 10. 
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Chapter 4 



ANALYSIS OF DATA 

v>. 

Rellahllltv of Raters 

Since much of the literature has questioned the reliability of essay 
raters, this study also concerned Itself with that problem. In order to 
ascertain whether or not rater variability existed in this experiment, a 
test of means was employed for each rater, pre and post. Knowing which ■ 
essays were rated by each of the three raters for both the pre and post 
tests, it was then necessary to compute the pre and post means and the 
mean differences for each rater. Since the mean difference in the overall 
score for the group was previously calculated by the computer, each 

grader's mean difference from the group mean differences was subtracted to 
find the variability of each from the group. 

Table 1 



Individual Grader Variance From the Group Mean Difference 



; Pre-Test i Post-Test 
P^^der 1 Meian • Mean 


i ^ 

I Mean 

} Difference 


1 Group } Variance From 

j Mean j Group Mean 

i Difference • Mfferpnrf> 


i 

A 


12.964 


1 r ( 

° 1 

15.660 i! 2.696 


r 

3.665 


, — 

-0.969 


B 


15.568 j 


1 21.098 


i 1 

! 5.530 


3.665 


+1.865 


! c 


! 

15.078 ! 

' p V 


17.941 


1 

2.863 : 3.665 


-0.802 ! 



These results would tend to Indicate that grader B graded significantly 
higher than the group mean while graders A and C were slightly below the 
group mean. If this were the case, the possibility of the group mean 
having been raised because of grader B’s grading practices Is possible. 
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Yet, upon closer analysis, it can be noted that the negative sums of 

graders A and C nearly- balance out grader B's above- the-g roup mean dlf 
ference. 

'5 



Table 2 

Actual Grader Difference Between 
Above and Below the Mean Graders 



Grader 


Mean Difference 


B 


+1.865 


1 A and C 


-1.771 


I 

^Actual Difference 


‘ ■ * ■ 1 > 

+0.094 



Wishing to further conflm that the graders did not vary significantly 
and to also confirm that grader B did not confound the results for the 
group, two other measures were made. A ”t" test was used to measure 
whether or not each grader’s mean difference varied significantly from 
the group mean at the .01 level. Graders A and C did not vary signifi- 
cantly, while grader B.did, Thus* in order to confirm that grader B 
did not confound the results the data was rerun through the computor 
without using the data of grader B» A paired "t" test was used and the 
results, reported more completely under Section 3, page S&4; confirms 
nhat even without the data of grader B.the group mean was still signifi- 
cantly different. 
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Table 3 

T Test to Determine Significance 
of Grader Variances 



Grader 


Group Mean j 
Difference '*t*' Value 


"t^' Value Needed 
for Significance 


A 


-0.969 


1.871 


2.326 


B 


+1.865 


] 

3.592 


j 

2.326 


C 


-0.802 


1,544 


2.326 


B - A4C 


40.094 


0.175 


2.326 



Data for Each Student on Each Area 

Unlike group results, the results of individual students cannot be 
calculated through a ”t" test to determine significance because there are 
no mean averages to use in computation of the statistic. VIhat can be 
done, though;, is to calculate the percentages of gain, loss, and stability 
and from these figures make a judgement. This was done by adding up all 
the columns of data for the group and determining how many students either 
gained, lost, or remained stable from the pre-test to the post-test. In 
all cases the number of students who gained on the post-test was greater 
than the loss on the post-test. With the exception of the area of style, 
the gain difference (number of students who gained minus those who lost 
in any one area) was always greater than thirty per cent or greater than 
forty-seven students per area considered. In addition to the following 
table, a group of frequency graphs and the total individual gain-loss 
data are collected in Appendixes 0 and B respectively pages 1064 and 
9S4. 
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Table 4 

Numerical and Percentage Figures for Individual Student 
Gain, Loss, and Stability for the Five Areas Tested 



1 

f 

i Area 


Student 

Gain 


Percentage 

Gain 


Student! Percentage | Studentl Percentage 
Loss Loss 1 Stable! Stable 


> 

; Content 


97 


, 1 

61.5 ! 41 


1 

1 25.9 


20 


12.6 


Organization 


98 


62.1 1 28 


1 

17.7 i 


1 32 


20.2 


] 

\ Style 


77 


48.9 


51 


32.2 


30 1 18.9 


! 

e 

I Mechanics 


78 


49.4 


28 


17.7 


52 ^ 32.9 


^ Overall 
! Score 


! 107 


67.8 


41 


25.9 


10 i 


6.3 



Tabl^ 5 

Numerical and Percentage Figures for the Gain 
Minus Loss Student Differences 



. ■ i, ■ — - 

« 1 

Area 


Gain - Loss 
Student 

1 Difference 


Percentage 

Difference 


Content 


56 


35.6 


Organization 


70 


44.4 


Style 


26 


16.7 


! Mechanics 


50 


31.7 


'overall Score 


66 


67.8 



Thus, though there was no statistical test of significance applicable 
to each individual student, the raw data would tend to Indicate that in 
all areas, except style, there was individual improvement greater than 
thirty per cent. 
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Analys is of Grc jp Data for all Five Areas Considered 

In terms of the entire group, there wece improvements seen in all 
five areas between the pre-test and the post-test. In order to measure 
group Improvementythe mean for the group was determined for both the 
pre-test and the post- test. By subtracting the pre-test mean from the 
post-test mean, the resultant mean difference, or group gain, was deter- 
mined. 



Table 6 

Pre and Post Group Means and ?-lean Difference 
for the Five Areas Tested 



j Pre-Test Groi^ 1 
Area i Mean ! 


Post- Test Group | 
' Mean 


! Group Mean 
Difference 


Content 1 3.92A 


4.981 


+1.057 


Organization 


3.683 


5.177 


+1.494 


Style 


4.234 


4.898 


+0.665 


Mechanics 


2.632 


3.094 


+0.462 


Overall Score 


14.487 


18.152 


+3.665 



To test whether of not these results were significant at the .01 level 
of confidence, it was necessary to apply a paired ”t‘' test to the mean 
differences of each area to determine statistical significance. The 
results of this test indicate that all five areas improved slgnlficari iy 
at the .01 level, because the ”t" value for each exceeds the minimum 
necessary for significance. 
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Table 7 

Paired T lest of Significance for the Five Areas Tested 



Area 


Group 

Mean 

Difference 


) 

1 Standard 
Deviation 


Degrees j 
of 

Freedom 


Value 


*'t” Value 

Needed for 
Significance 


Content 


+1.057 


2.186 


157 


6.08 


2.326 


Organization 


+1.494 


2.237 


157 


8.39 


2.326 


Style 


+0.665 


2.173 


157 


3.84 


2.326 


Mechanics 


+0.462 


1.160 


157 ! 


5.01 


2.326 


Overal 1 
Score 


TJ T . LI 1^ 

+3.665 


1 T . 

6.501 


1 

157 


1 

7.09 


2.326 



Because the paired "t" test indicates that the results for the group 
were significant at the .01 level and considerably beyond, further analy- 
sis of the group data was done in order to check if any extraneous vari- 
ables were affecting the results. Ti-zo areas that could very well have 
posed potential threats to the data were these i first, that grader B, 
significantly above the group mean, -was confounding the results; or, 
secondly, that since the experimental group is composed of both the 
average ability 111 sequence people and the 101 above average people that 
the results were being confounded by the 101 portion of the sample popu- 
lation. In order to check on these t \70 factors as possibly confounding 
the results, tests were devised to analyze both situations. 

In the case of the graders confounding the results, especially 
grader B, another paired "t” test was run vrithout Including grader B*s 
data. This was done because neither grader A nor grader C could have 
raised the group means for the five areas enough to warrant significance 
since their individual grotq> means were lower than the total group mean on 
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the area of overall score (see Table 1, page 53). The results of the pair- 
ed "t” test uaiag only the data from graders A‘ and C show that there 
was still significant Impiovement at the .01 level of confidence in all 
areas except style* As could logically be assis&edji the "t** values for 
graders A and C were lower (though still significant) x^lthout grader 
B*s data being Included. 



Table 8 

Paired T Test of Significance for the Five Areas Tested Using Only 
the Data of the Below the Group Mean Graders 



Area 


I Group 

j Mean 

i Difference 


Standard 
’ Deviation 


■ Degrees 
of ! 

i Freedom > 


1^11 

Value 


^ ’*t" Value 

; Needed for 
: Significance 


1 j 

I Content | 


1 

+0.776 


i 

j 2.220 


! 

i 106 


3.61 


1 2.326 


j 

Organization 1 


+1. >06 


' 2.073 


! 

0 

1 


6.02 


r" 

: 2.326 


1 

i Style j 


+0.430 


2.061 


! 106 


2.16 


! 2.326 


J 

t 

! Mechanics 


■ ■" ■ 1 
+0. 364 


1.128 


106 


3.34 


1 2.326 


! Overall 

1 Score j 


+2.776 


6.291 


r- 

106 * 


4.56 


\ 

' 2.326 



Though graders A and C did not achieve significance at the .01 level for 
style, it is doubtful that grader B confounded the group results since 
graders A and C did achieve significance in the other four areas. 

The second possibility, that the ^^bove average 101 students could 
have raised the group mean and confounded the results, was analyzed by 
separating the data into either the 111 population or the 101 popxtlatlon and 
running each group by itself. In the case of the 111 data, all five 
areas were again significant at the .01 level, which indicates that this 
group did not confound the overall results. 
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Table 9 



Paired T. Test of Significance Using Only the Data 
of the 111 Sequence Students 



1 

! 

Area 


Group 

Mean 

Difference 


1 ' i 

Standard 

Deviation 


; Degrees ^ 
of 

Freedcm I 


*' 

i "t" 

! Value 


"t^' Value i 

Needed for j 
Significance 


I 

i Content 


+1.346 


,,050 : 


1 

80 j 


j" — t 

i 5.91 


I 

2.326 


! 

1 Organization ' 


1.7P0 


2.306 ! 


! 

80 


1 

6.99 


2.326 


1 ! 

i Style ! 


+0, iyj.. 


2.291 


80 


3.73 ' 


; 

1 2.326 


1 > 

1 ( 

\ Mechanics ; 


0.395 


1.201 : 


80 


2.96 


2.326 


1 Overall j 

j Score 

f ' - 


+4.457 


; 6.660 


o 

00 


i 6.02 


2.326 



The results of the paired ''t“ test for the 101 students were similar with 
the exception of the area concerning style which did not reach significance 
at the ,01 level. In the other four areas there was a significant improve- 
ment at the .01 level. 

Table 10 

Paired T Test of Significance Using Only the Data 
of the 101 Sequence Students 



J 

) 

1 

Area j 


Group 

Mean 

Difference 


Standard | 
1 Deviation > 


Degrees ■' 
of I 

Freedom ? 


Value 


"t” Value j 
{ Needed for 
i Significance 


i 

Content i 

,1 1 1 


+0.753 


2.295 


; 

76 


2.88 


• 2.326 


1 

Organization ' 


^ +1.182 


2.132 


76 i 


4.86 

4.86 


2.326 


Style j 


+0.364 


2.013 1 




1.59 


1 2.326 


\ 

Mechanics 


i ' 

' 1 

+0.532 ! 

'■ 1 


j 

!- i 


- 76 ; 


4.18 


i 

2.326 


Overall 

Score 


1 

+2.831 


1 

1 6.265 J 


i 


3.97 


1 2.326 
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men measured Individually, then, both the 111 and the 101 populations 
showed significant Improvement at the .01 level with the exception of 
the 101 population on the area of style. These results tend to indicate 
that neither population had confounded the results for the entire group 
in any one area. When compared with each other, the 111 group and the 
101 group yield some Interesting data. In all cases, the 111 group im- 
proved more than the 101 group did on the areas of content, organization, 
and style. Likewise, the 111 group Improved more in the snme three, areas 
than did the total sample. This Improvemen,. can be clearly jeen on the 
polygon graph in Appendix D, page 113 , where the results of the 111 group, 
the 101 group, and the whole sample group are graphed together on the 
four previously mentioned areas. In addition, a graph of the overall 
score gains made by each of these roups is also included in Appendix D 
where once again the 111 group scoi 1 higher than did either the 101 
g np or the v7hole group. 

Analysis of tl^ Eight Questions Concerning Organization and Style 

To determine whether or not any significant differences were made 
pre and post on the eight questions, a computer was used to add up the 
total number of "yes*’ responses for each question on the pre-test and 
the post-test. Each question, and the pre and post "yes/no" responses 
follows . 
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Table 11 

Yes and No Tabulations for the Eight Questions Considered 
On the Essay Evaluation Sheet for Both Pre and Post Tests 



Question II A: Is the central idea (or thesis) clear? 



Pre-Test 


Post-Test 


Yes 


No 


Yes 


No 


74 


84 


1 111 


1 47 



Question II B: Are there ample details and examples to 

develop the central idea (or thesis?) 



[ Pre-Test 


Post- 


“Test 


Yes 


No 


Yes 1 


, No 


51 


107 


! 

80 ! 


1 

1 



Question II Cj Are the ideas developed in logical order? 



Pre-Test 


Post- 


-Test 


Yes 


No 


Yes I 


No 


36 


122 


67 ’ 


91 



Question II D; Are the transitions adequate? 



Pre-Test i Post-Test 


Yes 


No 1 Yes No 


23 


1 

135 1 53 i 105 



Question II £: Are Ideas given the emphasis required by 

their importance? 



Pre-Test | 


1 Post-Test 


Yes 


No 


1 Yes i No 




139 


1 ^ 

1 55 1 103 
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(Table 11 continued) 
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Question III A: Is the dlctloh accurate, x^ell-chosen, 

and aufflclently varied? 



1 Pre-Test 


Post- Test 


1 Yes No 


Yes 


No 


1 


117 


60 


98 



Question III B: Is the sentence structure effective? 



1 Pre-Test ! Post-Test j 


! Yes i No j Yes 


No j 


I 1 “i 

1 43 i 113 { 77 


81 i 



Question III C: Is there appropriate variety in ways of 

developing paragraphs? 



1 Pre- 


-Test 


Post-Test 


! Yes 


No ! 


Yes 


i No 


I 

! *3 




65 


! 

i 93 



Once the total ’’yes/no" responses were ^-abulated, the mean for the group 
on the *'yes'* responses for each question on the pre-test and the post- 
test was calculated. Subtracting the pre-test mean from the post-test 
mean, the mean difference was found which was then used in de terming sig 
nlficance using a standard *’t" test. 
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Table 12 

T Test of Significance for the Eight Questions 



Question 


Pre-Test 
Group Mean 
For Yes 
Responses 


Post-Test; 
Group Mean; 
For Yes | 
Responses 


i 

Group Mean 
Difference 


Standard 

Deviation, 

; 


Value 


1 

”t” Value ■ 
Needed for i 
Significance ' 


II A j 


.468 


.702 


.234 


.500 : 


5.882 


2.326 


\ 

\ 

II B j 


.322 


.506 


.184 


! 

] 

.500 I 


\ 

\ 

4.6251 


2.326 


II G 1 


.227 


.424 


.197 


.500 


) 

4.952 


2.326 


1 

II D. 


.145 


1 

.335 


.190 


.500 


] 

4.776 


1 

2.326 


I HE; 


.120 


.348 


' i 

.228 


1 

.500 


1 

i 5.731 


2.326 


■ III A 


.259 


.379 


.120 


.500 


1 3.016 


i 2.326 


1 

III B 


.272 


.437 


.215 


.500 


i 

5.404 


j 

1 2.326 


i III C 


.272 


.411 


.139 


i .500 


3.494 


1 2.326 



All eight of the questions showed a significant gain on the post- 
test over the pre-test at the .01 level of confidence. Thus, in addi- 
tion to the numerical Improvement made by the students^ there was also 
significant Improvement foimd in certain specified areas of organization 

and style. 



Since the tabulation of "yes/no'* responses does not deal in fre- 
quency distributions^ there is no formula for calculating the standard 
deviation. After a discussion with Dr. Charles Oprian.it was suggested 
by him to tise the .500 value in determining ”t” In the test of signifi- 
cance* 
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Analysis _o^ the ilean Differences for the Areas of Content s Organisation s 

Style ," MiTlte chant cs and the Mean Differences for the Eight Questions 

Though the data previously analyzed showed significant ItnproveTnent 
In all areas considered for the group as a whole* further analysis of the 
data was conducted to determine whether or not any one area Improved 
significantly more than another. Using a computer and the Duncan's 
Multiple Range Test, the four mean differences for the group on content, 
organization, style, and mechanics were analyzed. The overall score was 
not analyzed V7ith the other four since this area consisted of a cumula- 
tive total score for the other four areas. The results, both in terms 
of the computer and in terms of a chart of the Duncan test, are given 

below. 



Table 13 

Computer Format of the Duncan's Multiple Range Test 
on the Mean Differences of Content, 
Organization, Style, and Mechanics 

(Mechanics) (Style) (Content) (Organization) 

0.46 0.66 1.06 1.49 



Since the first line is under 0.46 and 0.66, no significant difference at 
the .01 I'svel existed between these mean differences. The same is true 
between the mean differences 0.66 and 1.06 as well as between 1.06 and 
1,49. Because the first line does not go under the last two mean differ- 
ences, 0*46 differs significantly from 1.06 and 1.49. Likewise, the 
second line shows that the mean differences 0.66 differs significantly from 
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1.49. In other words, significant differences at the .01 level exist 
between mechanics ai'.d content, medianics and organisation, and style 
and organization. These differences can be numerically presented by the 
follov/ing table of the Duncan test. The letters I with various subscripts 
represent the number of means that intervene between any two means being 
tested while the SSR is the shortest significant range which is the 
absolute amount of difference required for significance. In any case 
where the differences obtained by subtracting two means is greater than 
the given SSR value, significance exists at the .01 level. 

Table 14 

Numerical Representation of the Duncan’s Multiple Range Test 
on the Mean Differences of Content, Organization, 

Style and Mechanics 



r Mean Difference 

[ 




^0 




^2 1 

t 


SSR 

.01 


Hjir*-' ' . ^ - 

1 0.46 


0 


.20 


k .60 


I 

1.03 


0.477 


1 

i 

1 0.66 




o" 




Nv • 83 


0.461 


I 

1.06 






X .43 


' ‘ 1 

0.438 i 


1.49 








0 


i 

i 


Mean Differences i 


0.46 1 


1 0.66 


1.06 ! 


1.49 


L_ 



0,46 differs from 1*06 
0.46 differs from 1.49 
0.66 differs from 1.49 

The same Duncan test was also applied to the mean differences for the 
eight questions concerning organisation and style. Since there were 
eight mean differences being analyzed the computor analysis follows on 
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page 68, while the numerical table is given below. In the case of the 
eight questions there were nc significant differences at the .01 level 
for any of the means tested. 



Table 15 

Numerical Representation of the Duncan's Multiple Range 
Test on the Mean Differences for the Eight Questions 
Considered on the Essay Evaluation 
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Table 16 

Computer Format of the Duncan's Multiple Range Test for 
the Eight Questions Considered on the Essay Evaluation 



0.12 0.14 0.18 0.19 0.20 0.21 0.23 0.23 
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Chapter 3 



SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 



Summary 

For some time a need has existed for empirical evidence conr.crning 
the significance of the freshman composition program at Western Illinois 
University. An important problem was to test whether or not newly enrolled 
freshman students improved after one and one-half quarters of composition 
in terms of an analytic evaluation sheet which was used to numerically 
rate each student on the areas of content, organization, style, mechanics, 
and overall score on the essay. 

Prior to their initial enrollment in the Fall, freshman students are 
given an essay-type placement test which is used to place each student in 
one of two sequential composition programs. Since this essay test was 
graded using the analytic method above_^it became the pre-test for the 
experiment. By means of random sarapling^a group of 158 students vAd- 
selected as the experimental group to write post-test essays after one and 
one-half quarters of composition had been completed. Because this experi- 
ment was conceived of after the start of the academic year^ it was im- 
possible to form a control group to check any extraneous variables that 
may have confounded the results. Once the post- test essays had been 
written^ they were graded by the same graders who had graded the previous 
placement essays the past summer. Once both pre-test and post-'test scores 
were established^ the data was gathered together and a paired '*t” test 
was done using a computer. In addition to the paired *’t’* testj a Duncan's 
Multiple Range Test was used to pinpoint more accurately where possible 
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differences existed in the data collected. Thought the main data analysis 
concerned itself with group improvement^ the study also undertook to check 
grader reliability as well as running an analysis on eight questions which 
were included on the essay evaluation sheet. 

The general findings indicated that there was a significant improve- 
ment for the group on all areas considered at the .01 level of confidence. 
To further confirm these findings^ the data was divided into two groups-- 
the 111 program and the 101 program--in order to see if one group con- 
founded the overall results. The preliminary findings showed that in 
both cases significance existed at the .01 level except for the 101 group 
on the area of style. Tests of significance were done to check on grader 
reliability and variability and it was found that one grader graded sub- 
stantially higher than the other two as well as being significantly 
higher than the group mean. Since this was the case^ further tests were 
made to see if this variability had any adverse effects upon the group 
results; and it was found that in running the data without grader B’s 
results^ there was still significance at the .01 level thuu confirming 
that grader B did not confound the results. 

In addition to the tests of significance done on the raw data fron 
the essay evaluation sheets, the Duncan test on independent means was 
employed to see if any one area of concern was significantly different 
than the others. The results indicated that the area of mechanics did not 
improve as much as the area of organization. The Duncan test was also 
used to see if any of the eight questions differed significantly from 
any of the other questions, and the results showed that there was no sig- 
nificant difference among the eight. The mean differences for the eight 
questions was also calculated and analyzed through a "t" test which showed 
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that there was a significant difference in "yes" responses on the post- 
test indicating improvement on the specific aspects of organization and 
style for which the questions were designed. 

Thus, the overall conclusions drawn from this study indicate that 
freshman students do improve their writing ability after one and one-half 
quarters of composition although it cannot be definitely confirmed that 
the improvement was due solely to composition since no control group 
existed to control maturation and other possible extraneous variables. 

Conclusions 

Since there were a total of thirty null hypotheses being tested in 
this experiment, It seems best to discuss the conclusions drawn from the 
data in chapter four according to the specific groupings of the null 
hypotheses. In that regard each group is presented separately with their 
own general conclusions and the overall implications are discussed at 
the end of this section. 

1 . Reliability of Raters 

Though no specific null hypotheses were formulated concerning the 
raters and their reliability or variability, the following generalizations 
are applicable in light of the findings. 

Though rater B varied substantially frcm either rater A or 
rater C^it was noted that the negative variances of the latter two raters 
nearly balanced out the above- the-mean variance of grader B. With this 
being the case, the conclusion that grader B did not confound the group 
results significantly, a fact that is also confirmed through the paired 
"t" test run without the data of grader B, it can be made. Though grader 
B varied considerably from the other two, the variance is all but cancelled 
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out and the grading practices of all three raters can be considered 
reliable. This reliability is further confirmed by noting that the mean 
difference between grader A and grader C was less than .200 of one point, 
indicating the close relationship between the two, 

2. Analysis of each individual student on each area 

Though no parametric test of significance could be made on each indi- 
vidual student for each of the areas tested, there was an overall improve- 
ment of over thirty per cent (47+ students) on all areas except style. 
Since this was the case^ the following null hypotheses were rejected; 

There will be no significant difference pre and post for each student 
on the area of content. 

There will be no significant difference pre and post for each student 
on the area of organization. 

There will be no significant difference pre and post for each stu- 
dent on the area of mechanics. 

There will be no significant difference pre and post for each stu- 
dent on the overall essay score. 

The null hypotheses "There will be no significant improvement pre and post 
for each student on the area of style" Is not rejected. Since this null 
hypothesis was not rejected the indications are that curricular planners 
should give this area more attention. 

3 , Group Data on all Five Ayeas Considered 

Slnco grapp Iffiprovement was scon In all five of the following areas; 
content, organization, style, mechanics; and the overall score was valid 
at the .01 level of confidence, the following null hypothesis were 
rejected: 

There will be no significant difference pre and Post f. t the group 
on the area of content. 
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There will be no significant difference pre and post for the 

group In the area of organleatton. 

There will be no significant difference pre and post for the 
group In the area of style. 

There will be no significant difference pre and post for the 
group in the area of mechanics. 

There will be no significant difference pre and post for the 
group In the overall essay score. 

Since there was significant improvement^ it may be generalized that 
freshman students, measured as a group, do improve because of composition 
and other possible influences. These results further indicate that 
instructors are achieving the goals established by the Freshman Com- 
position Committee. 

Since the possibility existed that the study was being confounded 
due to the variance of grader B or the influence of the above average 
101 group, an analysis was made of both these situations. The only 
area that was not significant for the data of graders A and C was that 
of style, while the other four areas were significant at the .01 level. 
The results, therefore, do not indicate that grader B was influential 
in raising the group means significantly. What is Indicated, though, 
is that there may possibly be different interpretations of what con- 
stitutes tyle being incorporated by the three graders. If this is the 
case, as the data has thus far indicated, then a need exists to further 
define this area. To further check on any influences being exerted 
by testable sources, the group data was separated into individual 
groups of 111 and 101 students. The data for the 111 group Indicated 
that significant improvement existed in all five areas thus resulting 
in the rejection of the following null hypothessee 
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TliRre will be no fignificant difference pre and post for English 
111 on the area of content. 

There will be no significant difference pre and post for English 
III on the area of organization. 

There will be no significant Ufference pre and post for English 
111 on the area of style. 

There will be no significant difference pre and post for English 
111 on the area of mechanics. 

There will be no significant difference pre and post for English 
111 on the overall essay score. 

In the case of the 101 group, significance was noted in all areas except 

the area of style which was not significant at the .01 level. These 

results then reject the following null hypotheses: 

There will be no significant difference pre and post for English 
101 on the area of content. 

There will be no significant difference pre and post for English 
101 on the area of organization. 

There will be no significant difference pre and post for English 
101 on the area of mechanics. 

There will be no significant difference pre and post for English 
101 on the overall essay score. 

The null hypothesis, ’’There will be no significant difference pre and 
post for the 101 group on the area of style” is not rejected. The 
general conclusions drawn for the two groups indicate that neither group 
had confounded the whole group since each Individual group reached 
significance in all areas except the 101 group in the area of style. 
Again, the data tends to reflect that a significant number of students 
are not attaining competence In the area of style. This finding is sur* 
prising, since the 101 I'^vel students may be considered by many to be 
better equipped to handle problems of style than are students of 111 
ability. If this Is truly the case, then a definite need exists for more 
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concentrated worl; in the area of style with the 101 level students. 

4 . Analysis of the eij^ht questions 

The general fvr-dings indicate that significant improvement, in terras 

of increased "yes** responses on the post“test, existed for all eight 

questions on the essay eva.*ation sheet. These findings then cause the 

following null hypotheses to be rejected: 

There will be no significant difference pre and post in yes/ 
no responses to question II A on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question II B on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question II C on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question II D on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question II E on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question III A on the Essay Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question III B on the Essav Evaluation Sheet. 

There will be no significant difference pre and post in yes/ 
no responses to question III C on the Essay Evaluation Sheet. 

Since significance was found for these eight questions^ the general 

* Jf • 

conclusions previously drawn are further substantiated. As a group 
students were better able to organize their thoughts and as a group 
they were more cognizant of stylistic procedures after one and one-half 
quarters of composition. 

5 , General conclusions based on all the data analyzed 
As a group all students improved significantly on the five areas 
of content, organization, style, mechanics, and overall score, These 



o 

ERIC 







79 






76 

results indicate that the Freshman Composition program as it is now being 
administered, along with other factors, does succeed in improving student 
writing ability after one and one-half quarters. 

As a group the 111 students improved significantly in the five areaa 
of content, organization, style, mechanics, and overall score which tends 
to indicate that instructors are accomplishing the goals set for the 
syllabus for this sequence. ' • 

As a group the 101 students improved significantly in the areas of 
content, organization, mechanics, and overall score. Significant Improve- 
ment was not found to exist for the area of style. 

'i’he general conclusions drawn from the eight questions analyzed 
are that as a group students did improve their ability to organize their 
thoughts and to use good stylistic methods in their writing. The Duncan 
test of independent means found no significant differences existing for 
any one question over the others Indicating that though improvement was 
significant it was generalized for all eight questions tested. These 
findings, then, do not reject the following null hypothesis; 

There will be no significant differences between the group mean 
differences on yes responses for questions II A, II B, II C, II D, 

II E, III A, III B, and III C. 

The Duncan test of independent means employed for the four areas 

of content, organization, style, and mechanics found significant differencef 

between the area of mechanics and the areas of content and organization as 

well as a significant difference between the area of style and the area 

of organization, thus rejecting the following null hypothesis: 

There will be no significant differences between the group mean 
differences for the areas of content, organization, style, mechanic, 
and overall score. 
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These results indicete that the area of organization had the greatest 
improvement followed by content. The areas of style and mechanics had 
the least amount of improvement, although, since mechanics was rated on a 
five point scale, the findings may be misleading. In general, though, 
the weakest aspect of the composition program appears to be in the area 
of style followed by mechanics. 

These findings in the above paragraph are further confirmed by the 
comparative graph in Appendix D, page 113, where the area of organization 

la clearly that area where the greater Improvenent ie noted. This Is 

followed by content, mechanics (because of the five point scale instead 
of ten points), and style. Further, in all areas except mechanics, the 
111 group was higher than either the 101 group or the group as a whole. 
Though this is, admittedly, unusual, the greater improvement made by the 
111 students may be due to the fact that these students, considered by 
many to be below the ability of the 101 students, had a longer way to go 
in terms of improvement, and therefore moved further than the lOl stu- 
dents did. 
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Recommendations 

1. Freshmari compoaition at Western should be mair.tained as a required 
sequence for all freshman students. 

2. Since the study has indicated that a significant number of students 
had improved in their writing as a result of the rhetorical mode of 
teaching at Western, there is every reason to agree with the critics 
who are talking about accountability and behavioral objectives in 
English. Thus, future syllabi should be cast in behavioral terms 
and students should Indeed be evaluated as a result of having met 
the rhetorical behavioral objectives. 

3. The argument about whether or not to teach rhetorical skills has 
been decided affirmatively in this study. Thus, it is recommended 
that vigorous attention be made to the teaching of the following; 

(a) Discussion of a significant subjec.. intelligently and com- 
pletely. 

(b) Clear and effective or;?ani 2 atlon of the central idea. 

(c) Logical development of ideas. 

(d) Effective stylistic procedures. 

4. Because of the substantial improvement demonstrated by the rhetorical 
approach, the recommendation is that each instructor be professionally 
obligated to follow a syllabus predicated on the rhetorical approach. 

5. Primary objectives in freshman composition, as outlined by Kitzhaber, 
should be the service and liberal aspects of the discipline. 

6. Use of the evaluation form now included in the syllabus for the 
freshman composition sequence should be continued. 
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7. There should continue to be considerable pre-training In essay 

evaluation prior to summer for persons grading the placement essays; 

the present evaluation form should be carefully evaluated in such 
meetings * 

8. Students needing mechanical help should be given personalized atten- 
tion or class time should be devoted to this area. Thus, a close cooper 
ation of writing workshop Instructors and Instructors Is advised. 

9. In light of the disappointing results In style, the Freshman Composi- 
tion Committee should give strong consideration, especially In the 
101 sequence, to setting up behavioral objectives for effective 
stylistic procedures In writing In their curricular planning. 

10. Since some students did not Improve, further study should be made of 
their particular situation, especially since they represent what 
could be the freshman sequence population during a secon^^ quarter 

If a proficiency exam advance places the other students after one 
quarter. 

11. This study should be replicated, using a control group in order to 
check the Influence of maturation and other extraneous variables. 

12. The Freshman Committee would be wise to continue to experiment and test 
teaching effectiveness, as It has small, experimental groups of 
students working In various ways, 1. e., large group lectures, 
teaching machines, literature— based courses, private study, etc. 
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February 9, 1972 



Dear Student: 

You will recall that you wrote an essay this past summer so that 
you could be placed In freshman ccsnpositlon. Now you are required 
to write a second essay in order that we can determine the accuracy 
of the placement procedure. 

Please come to room 341 of Simpkins Hall at 7:00 p.m. on one of the 
following evenings: February 16 or February 17. Bring a pen. You 

will be there less than an hour. 



Sincerely, 




DR. ALFRED J. LINDSEY 
Director, Freshman Composition 

AJL/js 
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EVALUATION -- 35 POINTS 



1. Content: Does the student discuss a significant subject 



intelligently and completely? (10 points) 



1 23456789 1 ( 



II. Organization: Is the method of presentation clear and 

effective? (10 points) 


123456789 1C 


• , A. 


Is the central idea (or thesis) clear? 


YES 


NO 


B. 


Are there ample details and examples to develop the 
central idea (or thesis)? 


YES 


NO 


C. 


Are the ideas developed in logical order? 


YES 


NO 


D. 


Are the transitions adequate? 


YES 


NO 


E. 


Are ideas given the emphasis required by their importance? 

YES 


NO 


III. Style: Does the essay Incorporate effective stylistic . 

procedures? (10 points) 


1 2 3 4 5 


6 7 8 9 1C 


A. 


Is the diction accurate, well-chosen, and sufficiently 
varied? 


NO 


B. 


Is the sentence structure effective? 


YES 


NO 


C. 


Is there appropriate variety in ways of developing 
paragraphs? 


YES 


NO 



Other 

Concerns : 



Concerning mechanics, is the essay reasonably free of 
idiomatic difficulties, fragments, run-on sentences, 
comma splices, faulty parallel structure, mixed con- 
structions, dangling modlfleis, and errors of agree- 
ment, case and verb forms? Is the paper reasonably . 

free of spelling errors and punctuation errors? (o points) 



1 2 3 4 5 



TOTAL SCORE: — 
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This is your writing assignment. Read it carefully and follow it accurately. 
V/ritlng time is 50 minutes. 
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Before beginning the essay choose the one activity which you consider the most 
important means of expressing yourself. In the essay discuss what it Is about you 

that the activity expresses and how the activity best expresses It. 



Express your ideas in a well-planned essay of about 300 to 500 words • using several 
paragraphs to organize your discussion. Quality is more important than quantity. 
Your point of view should be supported by and illustrated from your won experience, 
or by appropriate references to your reading, study, or observation. Be specific. 
You are expected to express your best thought in your best natural manner. After 
you have written your essay, underline the sentence which you think comes closest to 
summarizing your CENTRAL IDEA . 



You will have fifty minutes of writing time for this exercise, from the supervisor *s 
instruction to begin work to the supervisor’s Instruction to S;.op . During this time 
you will write your essay, and you may make minor revisions if you wish and have time 
to do so. You are advised to use five or ten minutes at the end of the hour to check 
and correct your spelling, choice of words, and punctuatlonj as well as to find 
possible careless errors and deal with them. 



SCRATCHWORK MAY BE DONE on the blank space below or on the back of this page. You 
should not attempt to write a draft of your essay on this Assignment Sheet; you will 
not have~tlme to copy a first draft. If you make notes, be sure you make them on 

this sheet. 

CREDIT WILL BE GIVEN ONLY FOR IfHQT YOU WRITE ON THE ENCLOSED COMPOSITION PAPER, This 
Assignment Sheet will be collected and destroyed. 

WAIT FOR THE SIGNAL TO BEGIN WRITING ON THE COIIPOSITION PAPER. You should be thinking 
about the topic and making notes on this Assignment Sheet, but you permit- 

ted to begin writing on the composition paper until the supervisor tells you to do so. 

REMINDER: Use both sides of the composition paper. If you need more, raise your 

hand. Use ball point pen. 



Write you name at the top of your essay ! 



er|c 
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This is your writing assignment. Read it carefully and follow it accurately. 
Writing time is 50 minutes. 



How should a fun picnic be organized? 



xpress your ideas in a well-planned essay of about 300 to 500 words, using 
everal paragraphs to organize your discussion. Quality is more imrortant than 
uantity. Your point of view should be supported by and illustrated from your own 
i;:perience, or by appropriate references to your readings study> or o scxvat ono^ 
h specific. You are expected to express your best thought In your best natural 
mnner. After you have written your essay i underline tl« sentence w c y 
ernes closest to summarizing your CENTRAL IDEA . 



Y will have fifty nlnutes of writing time for this exercise, from 

iitruction to be?in work to the supervisor's Instruction to stofii During this time 
11 traction to oegin wotk uu f revisions if vou vlsh and have time 

^t:irs^\"io‘: rrrariSd ^ - check 

at correct your spelling, choice of words, and punctuation, as well as to tina 
pCilble careleae errors and deal with then. 



SMCHWOKK MAY BE DONE “ 

fo^ilvf^i^rr :o‘; rfrrs? ^ft.^Sn^uTaS notes, he su?e you make them on 
th. sheet. 

CIDIT Will BE GIVEN ONLY FOR WHAT YOU WRITE ON THE ENCLOSED COMPOSITION PAPER. Thi. 
As gnment Sheet will be collected and destroyed. 

yo to do so. 

REINDER: use bo* aides of the composition paper. If you need more, raise yonr 

hand. Use ball point pen. 



UtttB your name on the top of your essay! 
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This Is your wtitlng assignment. Read it carefully and follow it accurately. 
Writing time is 50 minutes. 



"The double standard still operates is Merica, but now females are 
treated betters than males." 

Why and in what ways do you agree or disagree with the above? 



Express your ideas in a well~planned essay of about 300 to 500 words, using several 
paragraphs to organize your discussion. Quality is more inportant than quantity. 

You point of view should be supported by and illustrated from your own experience, 
or by appropriate references to your reading, study, or observation. Be specific. 
You are expected to express your best thought in your best natural manner. After 
you have written your essay, underline the sentence which you think comes closest to 
summarizing your r ~HTRAL IDEA . 



You will have fifty minutes of writing time for this exercise, from the supervisor’s 
instruction to begin work to the supervisor’s instruction to s top . During this time 
you will write your essay, and you may make minor revisions if you wish and have time 
to do so. You are advised to use five or ten minutes at the end of the hour to 
check and correct your spelling, choice of words, and punctuation, as well as to 
find possible careless errors and deal with them. 



SCRATCWJORK MAY BE DONE on the blank space below or on the back of this page. You 
should not attempt to write a draft of your essay on this Assignment Sheet; you will 
not have time to copy a first draft. If you make notes, be sure you make them on 
this sheet. 

CREDIT WILL BE GIVEN ONLY FOR l-mAT YOU WRITE ON THE ENCLOSED COMPOSITION PAPER. This 
Assignment Sheet will be collected and destroyed. 

WAIT FOR THE SIGNAL TO BEGIN WRITING ON THE COMPOSITION PAPER. You should be think- 
ing about the topic and making notes on this Assignment Sheet, but you will not be 
permitted to begin writing on the composition paper until the sarpervisor tells you 
to do so. 

REMINDER; Use both sides of the composition paper. If you need more, raise your 
hand. Use ball point pen. 



Write your name on the top of your essay! 
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This la your wtitiog asolgnttoot. Rsad It carsfuUy sna foUov It seotrataly. 
Wrttlsg tlffis Is SO Blnutea* 




fkm do you think tbs ooXlsgs snviroiiBaat will dumgo your Uls stylo? 




EK^ross yeur idoss la 
sovsrel paragrsjbo to 
quantity* Tour point 
cm esRporlanco, or by 
vation. Be opscifie. 
best natural oanncr. 
which you think cooios 



a irell"plannsd asssy off about 300 to 500 wordSt using 
orRaniso your discussion# Quality io ®ot* iasportant thm 
off yi«r should be stq»portad by and lllustratod fron your 
anproprists rsfeesnoas to yot4r rsa«W.ng, study » or obscr* 
You are sxpsctod to enpress your best thought in your 
After you have written your es9^ > tpderUne the aantsn^ 
closest to atsmerlalna your CWfiaAb IPM ^ 



You will hffue fifty minutaa off writing tlae ffw this 

visor’s instruction to begin wotk to the supeinilsor’s iuotriictlon to gto£. 
Curing this tins you will wrTta your essay* and you «aka ^nor revisions 
if you wish and have tijse to do so* You axe advised to use flys or tan 
ttlnutes at the end of the hour to ehsek and correct your spalling, choics of 
coeds, sod pimeecatlan, •* wsU es to Itail poesibl* attoes and daaX 

with thesst 



gCEATCmmiat may BB dome on the blank space below or on the back of 
You shotad not attempt to wriu a draft of your essay on this Assignmsnt snest, 
you will not have tl?aa to copy a first draft* If you oaks notes, ha sure you 
Ridce then on this sheet* 

CEUSDIT MILL BE GIVEH OMLY FOE MRAI YO0 ^BRITE CM TSB BSCU>dED CCUPOSITIOE FAPBB* 
This Assignsant Sheet will ??s collected and destroyed* 

MIAT FDR THE SIGKAL TO BEOIM WRITEW ON THE OCSSPOSITICW PAPER* You should be 
thinking ebeut the topic and coking notas on this Assignment Shset, but you 
will not be pemltted to begin writing on the conpooltlcn paper until the 
supervisor tolls you to do so* 

EBKINBSRs Use bo^ sldse of the eonposttion paper* If you need more, raloo your 
hand* Use ball point pan* 



To i have been asked to fiU in your nags md address and date on an evaluation 
shenet* Be sure you fill In tills infoxmeti<m. Hrlta your naae on the top off your 
esaay* 
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— - «cew«tely, 

GlVtSn t-u^ - "" 



^*preaa your 4 

»y«m IwragraZ t ! *'*“-Pl«ane<J as«, 

than oua^tl^« v ®tg8nle« vour about 300 to ?nn .. ^ 

y»«r beat ^ST*’ *" .‘Si,**' 

clpaeat to auanarlaiT th“ 

vizi hav. — ~ ~ 

« ten Blaut.r« 5f^ •“*’ tlM^to d^” **"*5'* ““I ?»«• 

‘*»lce of wrda J5® *“^ the to cht'v ^®5 to «*■ 

®-« -aal'vj^ r-f-«on. „ 

SCEATCHWltit my 8* rwm.' " ^ 

“‘- ”»■ o. S: s;,“ “»^ . 

CREDIT wrrr b» “Otas, be sure you 

lOl- ^-ien-ant »«T TOO miy* ON m BNCLfl 

««r for bus SZeSAL m ‘ “ ““* ‘'PetroyaT^®® COMPOSIIion PAPffi, 

SaiSDERs Oe, ™'“ ‘»>e 
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This la ycur writicg easiensant* Beea it cateftsXly md follow it accurately 
Writix^ tlno la 50 olnutaa* 



It haa boon Chat moat of ths problemo our country is cumatXy 

Qod'^lng aTo duo to cvaxpcpulatiota* X£ the population ia sXXottod to 
cositinue Co grow, problema such aa pollution* uasploymantt and racial friction 
CCA oaXy get eoxae« gy thia lina of reaaooi^* it mWld aeea iaperetlvi 
that Icgioiatiuo actioa bo takon to establish coutrola ouet the risinc; birth 
rate* Urlto «a eaooy as^portins or denyisis the neoesolty of legielated 
population control. 



B3Cpre38 your ideas in a ireU*plaiined essay of about 300 to 500 words* ualng 
several para^aphs to organise your discussion. Quality Is more Importanc 
than quencity. Your point of view should be supported by and illustrated 
free yoiu: own experience* or by appropriate references to your reading* 
etudy* or ebsarvation. Be specific* You are expected to express your best 
thought In your best natural maimer. After 3rou have written your essay* 
underline the sentence which you think cones closest to swnaarislng your 
cxsr^mi. IDEA. 



You will have fifty ninutes of writing tine for this exercise* from the 
supervisor's instruction to begin tyotk to the supervisor's instruction to 
stop . During this time you will write your essay* and you nay nska minor 
revisions if you wish and have time to do so. You are advised to use five 
or ten minutes at the end of the hour to check and correct your spelling* 
choice of words* and punctuation* as well as to find possible careless 
errors and deal with them. 



SCBATC£R'7DRK MAT BE DOBE on the blank space below or on the back of this page. 
You should not attempt to write a draft of your essay on this Assignment 
Sheet; you will not have clma to copy a first draft. If you make notes* be 
sure you make them on this sheet. 

CHEDIT t^LL BE GIYE29 OMLT FOR MEAT YOU mtm 0^ THE ENCLOSED COMPOSITION PAPER. 
This Assignment Sheat will be collected and destroyed. 

kAIT FOR THE SIGKAL TO BEGIN 1®ITII*G ON THE COMPOSITIO!! PAPER. You should be 
thinking about the topic and making notes on this Assignment Sheet* but you 
will not be permitted to begin writing on the coc^ositlon paper until the 
supervisor tells you to do so. 

RBMDiDER: Use both sides of tbs coiapositlon paper. If you need morn* 
raise your hand. Use ball point pen. 



You have been asked to fill in your name and address and dato on 
an evaluation sheet. Be sure you filFln this information, yrite 
your naaa on the top of your essay. 
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Thia is your vritlng oaslgnstsot* Boad it carafully sod follow it sccuratsly* 
Vtriting tios Is 50 ntoutss. 

*4ii«'7deGi« oi^ a ftotloo srs rovssled io its sdvsvtiMMAts/' 

Judging fto» billboards, tclevielen cowoerciala, sod aewapapar 
and laagazlne sdvottlslns, what al^bt oiia infer about tha Ideals 
of the people of tlie United Sceteet 



Bopress your ideas in a wall**plasoed essay of about 300 to 500 words, using 
ssverol paragraphs to organise your diseuasion, Quality is »ra Inportant 
than quantity* Your point of view should be supported by end iUuatratad 
from your own experience, or by appropriate references to your reading, aMy, 
or obsarvation. Be specific* You are erpocted to express your best thought 
in your best natural nauier* After you havo written your esMy , jerlln j g ^^ the 

sentence which you think cooes closest to sung«arig ina your CEHTMj«-.^5g.* 



You will have fifty ninutes of writing ttnm for this exercise, from the super 
visor *e instruction to baf^in wrk to the supervisor's instruction to stop,. 
During this tins you will writs your essay, and you gay cake minor revisions 
if you wish and have tins to do so. You are advised to uae five or ten 
mlnutee at the end of the hour to check and correct your spelling, choice of 
words, and punctuation, aa well aa to find possible ceraloss errora and deal 
with thsai* 



SCRATCHWORK MAY BE DONE on the blank space below or on the back of this page* 
You should not attempt to write a draft of your essay on this Aaslgnoant Sheet; 
you will not have tine to copy a firat draft* If you wake notes, bo sure you 
nelce them on thia sheet. 

CREDIT WILL BE CIVEH OHLY FDR WBAT YDO WRITS ON TUB EUCtOSSD COMPOSITION PAPER* 
This Assignment Sheet will be collected end destroyed* 

UIZT rOR TUB SIGNAL TO BEGIN WRITING ON THE COMPOSITION PAPER* You should be 
thinking about ths topic and making notss on this Assignment Shast, but you 
will not be pomitted to begin writing on the ecnpoaitlon paper until the 
supervisor cells you to do so* 

REMINDBR: Ois both sides of the composition pepsr* If you need more, raise 
your band* Use ball point pen* 



You hava been asked to fill in your neae end eddjresa and date on 
an evaluation sheet* Be sure you fill in this information* Write 
your name on tha top of your assay* 
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Shio ie your writing astigonent. fttad it casefiiUy o&d folloir it aceuxataly* 

tiicG le 50 iBliiut4&0» 



n£;it*g specific incidonta end oboarv^stlons froa yoor cvn e^erienca to i2,lu9trato 
yocr general ideas » dlecvsn the Isiportoit diffemcas betiTaen urban HtIqs 
( laz^e cltiM) and rural U^g (oiBall toaaa and faiaa). Also, relate thaae 
differaocaa to diffezencee in social* acral* and political values held by the 
people In both eategoriaa. 



Sapresa your Ideae in a weH-plaimed aseiqr of about 300 to 500 aorde* using 
oaveral paragraphs to orgaalaa your discuoalon* Quality is »ora inportaut than 
quantity. Your point of vlair should be supported by end illustrated free your 
own e 9 q;erience» or by appropriate a'ofaranees to your raadisg* etudy* or obaar- 
vatioo. fia epaciflc. You ara isrpccted td arprass your bast thought in your 
bast natural aaxmar. After you have f/rltten your aaasy* undarliaa. jdie ..s.<wtanca 
which you think coaaa closaat to your OniT^li P>BA» 



You will have fifty vlnutea Of writing tine for thie erarelsa* froa the supar< 
viaor*a Inatruetlon to begin work to the aur^i^isor’e instruction to f£SE* 
During this tlae you will write your assay* and you way naka ^nor ravlsiona 
if you wish and have tlaa to do ao. You are advised to use five or t^ 
ainuteeatthe end of the hour to cheek and correct your spalling* choice or 
voids* Slid punctuation* as wall as to find possible caralaas arrois’c #ind deal 
with them* 



8CHATCHHOHK ittY BS WMB OD th. blank apsca belair ar an Cka back of thia pap. 
You idiould not attanpt to inrlca a draft of your aaaar on thla AatlgnMut Shaat; 
you win noilav. tlna to c<vy • ** T*" “***•*' *’* *“* 

tsehe them on this eheeto 

CRB3)IT WIIX S3 GIVEN ONLY BOk WHAT YOD WDIOT ON THB ENCLOSS) CMfPOSITIOH PAFCR. 
Thia Aaslgoment SbAat will be collected and dMttoy^d* 

mn IDS TEB SXQIAL TO BSGZN NktTZNG ON TBB CC!0OSinON PAPER. You abovid be 
thinking about the topic and meking notea on this Asslgnoeat Sheet * but you 
will not be psralttwd to begin vrlt.ii>g on the coapositioa pepsr until the 
supervisor telle you to do ao# 

SSHXNDSRx 0se both sides of the compositloo paper* If you need nora, raise 
your hand# Dee ball point pan. 



You have bean aekad to fill in your npne and addregs and date on 
an evaluation sheet* Be eure you fill In this infomation* Nrita 
your name on the top of 3 rour aecsy. 
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APPENDIX B 
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